-- Logs begin at Thu 2022-07-28 05:21:45 UTC, end at Thu 2022-07-28 06:36:14 UTC. -- Jul 28 05:57:09.429427 dv-cinder-812429-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 05:57:09.436988 dv-cinder-812429-2-smb devstack@keystone.service[80310]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 05:57:09 2022] *** Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: nodename: dv-cinder-812429-2-smb Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: machine: x86_64 Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: clock source: unix Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: pcre jit disabled Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: detected number of CPU cores: 4 Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: current working directory: / Jul 28 05:57:09.439037 dv-cinder-812429-2-smb devstack@keystone.service[80310]: detected binary path: /usr/bin/uwsgi-core Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: your processes number limit is 47680 Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: your memory page size is 4096 bytes Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: detected max file descriptor number: 2048 Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: lock engine: pthread robust mutexes Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: thunder lock: enabled Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 05:57:09.439574 dv-cinder-812429-2-smb devstack@keystone.service[80310]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 05:57:09.480774 dv-cinder-812429-2-smb devstack@keystone.service[80310]: Python main interpreter initialized at 0x557e9fafb9c0 Jul 28 05:57:09.480774 dv-cinder-812429-2-smb devstack@keystone.service[80310]: python threads support enabled Jul 28 05:57:09.480774 dv-cinder-812429-2-smb devstack@keystone.service[80310]: your server socket listen backlog is limited to 100 connections Jul 28 05:57:09.480774 dv-cinder-812429-2-smb devstack@keystone.service[80310]: your mercy for graceful operations on workers is 90 seconds Jul 28 05:57:09.481173 dv-cinder-812429-2-smb devstack@keystone.service[80310]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 05:57:09.481173 dv-cinder-812429-2-smb devstack@keystone.service[80310]: *** Operational MODE: preforking *** Jul 28 05:57:09.481451 dv-cinder-812429-2-smb devstack@keystone.service[80310]: *** uWSGI is running in multiple interpreter mode *** Jul 28 05:57:09.481451 dv-cinder-812429-2-smb devstack@keystone.service[80310]: spawned uWSGI master process (pid: 80310) Jul 28 05:57:09.481662 dv-cinder-812429-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 05:57:09.482373 dv-cinder-812429-2-smb devstack@keystone.service[80310]: spawned uWSGI worker 1 (pid: 80322, cores: 1) Jul 28 05:57:09.482589 dv-cinder-812429-2-smb devstack@keystone.service[80310]: spawned uWSGI worker 2 (pid: 80323, cores: 1) Jul 28 05:57:09.485005 dv-cinder-812429-2-smb devstack@keystone.service[80310]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 05:57:15.184413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:57:15.184413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jul 28 05:57:15.185587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:57:15.185587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jul 28 05:57:15.188777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:57:15.188777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: from cryptography.utils import int_from_bytes Jul 28 05:57:15.189293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:57:15.189293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: from cryptography.utils import int_from_bytes Jul 28 05:57:15.235306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:57:15.235507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:57:15.235778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] command line args: [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:57:15.235947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:57:15.236093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ================================================================================ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:57:15.236352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.236593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_dir = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.236824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.237028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_source = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.237169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] debug = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.237409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.239704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.239955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.240227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.240469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.240671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:57:15.240777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.241083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:57:15.241185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_config_append = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.241250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] command line args: [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:57:15.241315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.241375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_dir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.241444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:57:15.241640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.241746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ================================================================================ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:57:15.241896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] admin_token = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] config_dir = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.242862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] config_source = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] debug = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.243921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.244918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_config_append = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_dir = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.245899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.246931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.247233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.247431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.247627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.247731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] publish_errors = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.248982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] standard_threads = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.249891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_journal = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_json = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.250810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_stderr = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] publish_errors = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_syslog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.251736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.251860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.251994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.252120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.252359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.252493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.252778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.253020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.253234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] standard_threads = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.253392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.253596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.253787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.253977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.253977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.254282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.254415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] use_journal = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.254415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] use_json = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.254664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.254791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] use_stderr = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.254791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] use_syslog = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.255037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:57:15.255294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.255963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.256884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.257783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.258867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.259890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.260934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.261878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.262914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.263939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.264870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.265974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.266991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.267884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.268996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.269131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.270319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.270319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.270697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.270891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.271914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.272367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.272727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.273080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.273420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.273420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.273991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.274161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.274466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.274805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.274805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.275464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.275713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.275964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.276195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.276195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.276719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.276862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.276862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.277971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.278175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.278175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.278624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.278850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.279847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.280905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.281983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.external = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.password = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] auth.token = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.282970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.284036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.285138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.286615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.286615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.286615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.286615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.287088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.287088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.287325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.288884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.289267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.289267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.289601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.289601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.289957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.290199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.290348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.290478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.290608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.290894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.291125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.291270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.291836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.292935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.293897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.294970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.295928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.296995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.297818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.298941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.299160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.299313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.299478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.299663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.299869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.300967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.301151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.301801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.301801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.external = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.302899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.password = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.303950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.token = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.304788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.305941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.306865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.307896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.308950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.309962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.310913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.311947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.312193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.312329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.312627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.312851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.312982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.313123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.313281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.313612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.313777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.313947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.314863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.315012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.315206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.315342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.315633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.315777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.316050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.316191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.316463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.316607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.316868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.317023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.317297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.317441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] role.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.317595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.317840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] role.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.318877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.319920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.320893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.321987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.322808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.323891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.324876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.325979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.326784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.327862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.328848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.329934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.330088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.330416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.330650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.330881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.331631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.332253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.332507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.332828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.333063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.333292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.333517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.333752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.333986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.334884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.335972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.336979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.337994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.338190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.338381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.338590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.338772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.338915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.339878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.340992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80322) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.341990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.343108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.344299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.345869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.346002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.346272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.346498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.346703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.346939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.347168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.347429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.347637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.348469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.348765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.349016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.349251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.349484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.349712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.349946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.350181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.350426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.350661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.350914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.351156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.351392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.351632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.351875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.352117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.352352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.352590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.352849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.353091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.353337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.353603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.353805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.354125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.354383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.354630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.354949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.355113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.355311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.355584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.355774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.356002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.356287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.356507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.356748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.356995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.357230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.357480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.357707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.357963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.358163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.358397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.358628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:57:15.358879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:57:15.372571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.372984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.373147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.382306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.385170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.385402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.385647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.394466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.414738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.415114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.415356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.415614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.471719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.472058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.524490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.524745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.525308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.525543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.592470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.592768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.592885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.592996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.593828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.618549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.618758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.618895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.618987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.619923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.620070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.631151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.631408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.644346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.644591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.645850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.646750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80322) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:57:15.663888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.664165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:57:15.664412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.664612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:57:15.664801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.664934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:57:15.665188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:57:15.665719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.665968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.666218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.666463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.675571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.675909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.676230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.676468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.676737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.676931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.677116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.677320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.683659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.684368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.688811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.689127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.689439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.689647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.689824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.689988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.690938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.691928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.692110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.692375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.716682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.718344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.718617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.719020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.720110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.720491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.723915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.724208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.724463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.725834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.726153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.726546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.731378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.731663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.733418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.733714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.735939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.736225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.736512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.736824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.737092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.737364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.737623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.738019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.738157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.738377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.738688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.738957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.739228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.739492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.739768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.740040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.758465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.758796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.761651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.761992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.765052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.766207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.770631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.770927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.771160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.771387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.775895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.778417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.779403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.782800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.783063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.783216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.783385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.783665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.783949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.784235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.787498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.787816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.788187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.788599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.788830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.789075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.801128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.801506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.801690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.801934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.807230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.807686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.808085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.808470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.811637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.813859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.814326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.817945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.818294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.818462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.818620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.818773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.819052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.819610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.819883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.822829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.823111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.823394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.823679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.823961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.830816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.831168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.831376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.831663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.832208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.833285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.833745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.836788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.837056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.837284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.837553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.837822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.838087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.838359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.850257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.853318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.854610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.857548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.857765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.859026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.860519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.860827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.861061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.861251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.863607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.865406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.865689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.865966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.868359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.869954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.872623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.872861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.873153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.873436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.873709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.874763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.877842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.878197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.878487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.878746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.882647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.882930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.883217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.887717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.888001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.888268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.890324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.890601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.890878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.891262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.891545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.891835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.892112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.892390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.892678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.892962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.893235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.893508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.893784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.894040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.896436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80322) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:57:15.897030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.897030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.897986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.897986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.897986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.899466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.899466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.899466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.899466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.899466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.900827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.900827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.900827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80322) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:57:15.928083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e9fafb9c0 pid: 80323 (default app) Jul 28 05:57:15.931701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ebfda-c960-4bb1-a1f1-eda2ae31b951 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:15.931988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ebfda-c960-4bb1-a1f1-eda2ae31b951 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:15.932264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ebfda-c960-4bb1-a1f1-eda2ae31b951 None None] PATH_INFO: `/v3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:15.938566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Thu Jul 28 05:57:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:15.938861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e9fafb9c0 pid: 80322 (default app) Jul 28 05:57:23.885853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:23.886486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:23.886486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:23.887961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:23.895758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:23.896257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:23.896382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:23.969965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: INFO dbcounter [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] Registered counter for database keystone Jul 28 05:57:23.993114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG oslo_db.sqlalchemy.engines [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80322) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:57:24.001692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writer thread running {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:57:24.186069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG passlib.handlers.bcrypt [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80322) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:57:24.186405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG passlib.handlers.bcrypt [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80322) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:57:24.241819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:24.243433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:24.374033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1/3] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 05:57:24.534878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:24.604815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: INFO dbcounter [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] Registered counter for database keystone Jul 28 05:57:24.625227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG oslo_db.sqlalchemy.engines [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:57:24.632335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writer thread running {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:57:24.751569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15da70-434e-4640-8067-8d263ac506ef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:24.755823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:24.756459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:24.756760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:24.757031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:24.765363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:24.817752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:57:24.817984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b49e4-8d9e-4c21-9c59-79d1521241e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:24.828252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1324 bytes} [Thu Jul 28 05:57:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:57:24.835237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:24.851410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fe74e-6b92-4a4b-ad04-b8a0411d9668 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:24.856245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:24.857432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:24.857715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:24.857991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] PATH_INFO: `/v3/projects/451944c8b2d04df49098731529a931c8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:24.859660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] RBAC: Authorizing `identity:get_project(project_id=451944c8b2d04df49098731529a931c8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:24.910864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:57:24.911582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6330d6-a535-42b1-b283-65bac40f861c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:24.915950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 2/5] 10.222.0.66 () {56 vars in 1207 bytes} [Thu Jul 28 05:57:24 2022] GET /identity/v3/projects/451944c8b2d04df49098731529a931c8 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:26.958413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7b288-8d28-4cdb-af79-67f4e50f61b4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:26.959151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7b288-8d28-4cdb-af79-67f4e50f61b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:26.959151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7b288-8d28-4cdb-af79-67f4e50f61b4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:26.963246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 4/6] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:26.969256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:26.969754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:26.969842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:26.991161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:26.992715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:27.000616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 05:57:27.022971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7b288-8d28-4cdb-af79-67f4e50f61b4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:27.035496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7b288-8d28-4cdb-af79-67f4e50f61b4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:27.039926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:27.040871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:27.040871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:27.041088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:27.049406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:27.051666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff62b1a-31ad-4e65-9858-0a7df41a5d8e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:27.062558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1324 bytes} [Thu Jul 28 05:57:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:57:27.071805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:27.082703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c415139-df58-49e8-abf8-1a823a51827c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:27.087158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:27.087813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:27.088095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:27.088365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:27.090085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:27.092922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658ea8-ad76-4496-9139-cb3b2854a566 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:27.095149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 4/9] 10.222.0.66 () {56 vars in 1198 bytes} [Thu Jul 28 05:57:27 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:29.176459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bc647-92d3-4bb5-8beb-5bd574709721 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.177014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bc647-92d3-4bb5-8beb-5bd574709721 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.177014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bc647-92d3-4bb5-8beb-5bd574709721 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.178368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:29.183560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.183978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.184114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.203524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:29.204735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:29.268695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637880d-1993-4c2e-affd-c72d940d2cb6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.269295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637880d-1993-4c2e-affd-c72d940d2cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.270113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637880d-1993-4c2e-affd-c72d940d2cb6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.271446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 7/11] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:57:29.276487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.276797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.277071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.284629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 5/12] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:29.307654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.321172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:57:29.321607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:57:29.331801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:29.367756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:29.369290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:29.416326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4f0ba-a433-4180-9625-2fc87234ed85 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:29.453626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:29.454277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.454552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.454826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.466990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:29.471673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:29.476268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:29.477361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:29.478307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 6/14] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:57:29.484932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.493519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.575094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:29.585711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a668941-023c-475e-b0b3-e560c5a268d5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:29.588618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:29.595271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfc726-3c64-4a50-b488-fec2663e5a17 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:29.628447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:29.628743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:29.629781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.629953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.630065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.630235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.630321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.630503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.631204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:29.631528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:29.633021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:29.645907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 9/15] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:29.651579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.701633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:29.703120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:29.757905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596d384-8284-4b76-84d0-cddddc345655 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:29.792269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:29.793193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.793469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.793735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.795375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:29.796887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:29.798904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 10/16] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:29.805352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.842760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:29.893364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:29.912724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 7/17] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:57:29.913099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d538cf4-2f1a-4731-9655-e942f6635857 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:29.918674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:29.948298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:29.948966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:29.949246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:29.949513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:29.950640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:29.952068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:29.953658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 11/18] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:29.959782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:30.026569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c78fc3-560b-431a-bffb-0b509349299d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:30.059028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1bbc3-ca21-485a-b3f5-53e2bf172c3d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:30.060529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:30.063893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:30.064539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:30.064842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:30.065115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:30.076030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:30.077517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:57:30.095966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:30.096860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:30.099195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:57:30.099195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:57:30.099195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:57:30.099195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:30.099195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 8/19] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:57:30.099490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:30.099959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:30.100241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:30.100514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:30.101383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.domain.id=default, user.id=03e8dd2f02b7463797c3e9d1f831c5fd) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:30.101689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:30.103140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f67a3b-88a7-4438-8742-36c6d6f4950c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:30.103482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:30.112292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 12/20] 10.222.0.66 () {56 vars in 1322 bytes} [Thu Jul 28 05:57:29 2022] GET /identity/v3/role_assignments?user.id=03e8dd2f02b7463797c3e9d1f831c5fd&scope.domain.id=default&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:30.140522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:30.213340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4f20-7f2e-4b0b-87d9-a21e658d64c5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:30.250071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:30.250706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:30.250981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:30.251251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:30.251949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:30.252248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:30.253804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf624b1-dbb7-4765-9ea6-72aff69f01eb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:30.274660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 9/21] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:32.295949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc33b-120f-4962-9594-1b9c8a3e6ab7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:32.296449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc33b-120f-4962-9594-1b9c8a3e6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:32.296625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cc33b-120f-4962-9594-1b9c8a3e6ab7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:32.298049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 13/22] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:32.314489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:32.315399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:32.315888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:32.341592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:32.343417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:32.416369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 10/23] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:32.450387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cc33b-120f-4962-9594-1b9c8a3e6ab7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:32.581325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cc33b-120f-4962-9594-1b9c8a3e6ab7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:32.621890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:32.622537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:32.622819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:32.623091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:32.646404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:32.655327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:32.656164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:32.656969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 14/24] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:32.662555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:32.705166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:32.836434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb46146-766c-4dca-885d-7cd8c2984dee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:32.919124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:32.920175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:32.920669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:32.921171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:32.922445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:32.922985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:32.925511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dc89e-85e8-4a18-992d-3161bd46afe0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:32.958561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 11/25] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:32.964538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:33.044774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:33.138104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea01ab-ebee-46a0-b938-3aaf9866b495 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:33.163158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071a91-5765-4c83-8be0-7459a7031ee3 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.164019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071a91-5765-4c83-8be0-7459a7031ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.164844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071a91-5765-4c83-8be0-7459a7031ee3 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.167492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 12/26] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:33.174734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3dfb-4df2-4dc3-91e4-e6af0d85798a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.175533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3dfb-4df2-4dc3-91e4-e6af0d85798a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.176887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3dfb-4df2-4dc3-91e4-e6af0d85798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.184675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:33.184675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.184675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.184675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.189452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:33.191039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:33.193035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 15/27] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:32 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:33.198436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:33.238344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8cfe3dfb-4df2-4dc3-91e4-e6af0d85798a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:33.241215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8cfe3dfb-4df2-4dc3-91e4-e6af0d85798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:33.309307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ee9-3387-4226-b399-464a07198f3a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:33.313093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:33.349917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:33.350818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.351383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.352574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.354592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:33.357322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf71607-9efa-4c69-bf67-1639171cb3b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:33.359925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 16/28] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:33.369940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a81ee-d816-4b28-985a-b89ed3afa944 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.370427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a81ee-d816-4b28-985a-b89ed3afa944 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.370973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a81ee-d816-4b28-985a-b89ed3afa944 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.372517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 17/29] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:33.373343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a81ee-d816-4b28-985a-b89ed3afa944 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:33.432209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 13/30] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:33.435356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.436137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.436949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.467952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:33.469188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:33.498340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:33.564427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a81ee-d816-4b28-985a-b89ed3afa944 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:33.597236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 14/31] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:33.599332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:33.774245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9bec5-3ed6-4369-880e-258f67ba46d0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:33.774482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:33.777468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.777468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.777468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] PATH_INFO: `/v3/domains/default/users/03e8dd2f02b7463797c3e9d1f831c5fd/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.779882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=03e8dd2f02b7463797c3e9d1f831c5fd, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:33.782479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eac19b-802d-45d2-8065-788bf3225a69 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:33.838231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:33.839362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:33.840081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:33.840844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:33.842366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:33.845155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927d46-62b3-41e3-8c7c-08e269cbf2b2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.000846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 18/32] 10.222.0.66 () {58 vars in 1361 bytes} [Thu Jul 28 05:57:33 2022] PUT /identity/v3/domains/default/users/03e8dd2f02b7463797c3e9d1f831c5fd/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:57:34.004805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee152-ade6-4087-9902-a654d5347039 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.005461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee152-ade6-4087-9902-a654d5347039 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.006097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfee152-ade6-4087-9902-a654d5347039 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.019442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 19/33] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:34 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:34.022226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfee152-ade6-4087-9902-a654d5347039 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:34.062845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 15/34] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jul 28 05:57:33 2022] POST /identity/v3/roles => generated 219 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:34.065735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.067101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.067812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.096704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.100746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:34.104161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:34.119953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.272399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 16/35] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:34.302589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:34.331659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfee152-ade6-4087-9902-a654d5347039 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:34.398105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:34.398971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.399447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.399913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.433516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:34.436282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:57:34.468231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:34.469873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:34.472267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:57:34.472267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:57:34.472267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:57:34.472267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:34.472267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 20/36] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:34.480000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:34.549355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d981-6f19-4c89-b547-3a8d33690af3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:34.600094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:34.600683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.600973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.601255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.602019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:34.603667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6564a8-6f79-470c-adcf-1f31518e9d84 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.608091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.621888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 17/37] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jul 28 05:57:34 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:57:34.623216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08306-d0db-4fa4-95d0-ec702f19f76f None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.623512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08306-d0db-4fa4-95d0-ec702f19f76f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.625852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.629575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08306-d0db-4fa4-95d0-ec702f19f76f None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.631100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 18/38] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:34.641340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.641632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.641970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.668594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ee6b-aabf-4708-951b-f89431f6f403 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:34.669967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:34.671434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:34.715957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:34.717119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.717623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.718135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.719074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:34.719584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:34.721291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.751188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 21/39] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:34.759750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:34.772246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 19/40] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:34.810585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:34.921903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd89a5-ec8b-41f7-b917-8acc5554f88b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:34.924575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b1560-54cb-4fe3-b30b-78318f1ed78f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:34.952863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.964181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:34.964952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.965238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.965617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.966355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:34.967345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:34.967876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb7ff8-db05-48af-b1af-187b7244f135 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.968030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:34.968248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:34.968513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:34.969240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:34.970688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953458a3-1ad8-423d-887d-d9f2866dc0db None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:34.977927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:34.987375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jul 28 05:57:34 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:35.009061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:57:34 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:57:35.052012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751e6a-45c2-441d-83ad-8902099249cb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:35.052366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751e6a-45c2-441d-83ad-8902099249cb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:35.052588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751e6a-45c2-441d-83ad-8902099249cb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:35.053987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 21/43] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:35.060759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7699-4171-485c-be12-13050d3d550d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:35.061136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7699-4171-485c-be12-13050d3d550d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:35.061373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7699-4171-485c-be12-13050d3d550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:35.082826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-448a7699-4171-485c-be12-13050d3d550d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:35.084473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-448a7699-4171-485c-be12-13050d3d550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:35.181266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 23/44] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:35.204446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0751e6a-45c2-441d-83ad-8902099249cb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:35.323435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0751e6a-45c2-441d-83ad-8902099249cb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:35.360388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:35.361060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:35.361339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:35.361612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:35.362762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:35.364262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2e25-ddf2-4a38-9fc0-8d152fa34344 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:35.365882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 22/45] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:35.371830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7699-4171-485c-be12-13050d3d550d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:35.469459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7699-4171-485c-be12-13050d3d550d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:35.485439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:35.503247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:35.504384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:35.504699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:35.504978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:35.506467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:35.510699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d992-c687-497c-a151-27058179f5e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:35.538002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:57:35 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:57:36.588050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dd62-7962-4c4c-b5cc-4636fdf27e4e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:36.588563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dd62-7962-4c4c-b5cc-4636fdf27e4e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:36.588670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dd62-7962-4c4c-b5cc-4636fdf27e4e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:36.590009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 23/47] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:36.595340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:36.596035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:36.596035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:36.615276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:36.616462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:36.688520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 25/48] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:36.711919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2dd62-7962-4c4c-b5cc-4636fdf27e4e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:36.772032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:36.821670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2dd62-7962-4c4c-b5cc-4636fdf27e4e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:36.854486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:36.855051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:36.855335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:36.855611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:36.867499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:36.872434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:36.873307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:36.874045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 24/49] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:36.880150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:36.973445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:36.977158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edcad0-e962-4b95-a363-0d4e90e57111 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.011061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.011676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.011956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.012226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.012968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:37.013272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.014736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:37.023384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 26/50] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:37.029066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:37.142696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28bc2-0ca8-4f1d-9257-6e7f0da2860b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.156792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:37.177657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.178304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.178589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.178868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.180025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.181529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:37.183126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 25/51] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:37 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:37.189157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:37.293661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8246ff-6a0d-4634-9423-43e2cbb3bedd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.327044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.327674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.327949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.328216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.329368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.330800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9da3b-26e6-473f-b69f-4f67950c6f83 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:37.332702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 27/52] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:37.338929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:37.450178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a14b7-bff7-47f6-9cf2-3907532d6e11 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.495116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.495740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.496020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.496292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.497112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.domain.id=default, user.id=03e8dd2f02b7463797c3e9d1f831c5fd) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:37.497424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.498861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94e40-ebea-4d26-a6d7-34a75832dc97 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:37.506958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1322 bytes} [Thu Jul 28 05:57:37 2022] GET /identity/v3/role_assignments?user.id=03e8dd2f02b7463797c3e9d1f831c5fd&scope.domain.id=default&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:37.578164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1249-ea01-47b2-9ed2-c9c14faa91a3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.578443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1249-ea01-47b2-9ed2-c9c14faa91a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.578718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1249-ea01-47b2-9ed2-c9c14faa91a3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.580098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 28/54] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:37.586243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.586535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.586816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.606279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:37.607515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:37.653338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:37.680816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 27/55] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:37.704318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1249-ea01-47b2-9ed2-c9c14faa91a3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:37.733360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:37.808488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf1249-ea01-47b2-9ed2-c9c14faa91a3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.840542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.841200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.841482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.841755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.842926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.844354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0eb7-1f9b-467d-af13-7e76cf52aa5a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:37.845966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 29/56] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:37.852425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:37.947954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36935e-b4ba-41c9-8937-8fa84e3b5ea6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:37.981708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:37.982234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:37.982515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:37.982787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:37.983473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:37.984949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fafd9-78b5-49ac-8770-45561ddbb713 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:38.011397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 28/57] 10.222.0.66 () {60 vars in 1140 bytes} [Thu Jul 28 05:57:37 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:40.051652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788e96-d806-4464-bd67-7521d03842d2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:40.052172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788e96-d806-4464-bd67-7521d03842d2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:40.052283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788e96-d806-4464-bd67-7521d03842d2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:40.053597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 30/58] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:57:40.059038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:40.059521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:40.059875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:40.078238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:40.079579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:40.102484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:40.148387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 29/59] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:40.172185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788e96-d806-4464-bd67-7521d03842d2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:40.265336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:40.272916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788e96-d806-4464-bd67-7521d03842d2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:40.305089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:40.305656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:40.305937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:40.306210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:40.307350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:40.308830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d1a12-f7a0-43eb-ab77-08218b06ca71 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:40.310406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 31/60] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:40.315959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:40.418904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4938a42-dff1-482a-81de-847fd2230c8c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:40.453240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:40.453853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:40.454136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:40.454412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:40.455102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:40.456550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dbb96-01d4-4bfa-85d4-729d5b0ad835 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:40.482502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 30/61] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:57:40 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:43.598086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7fa3-1e42-407f-bd47-81b6df46b4a9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:43.599038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7fa3-1e42-407f-bd47-81b6df46b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:43.599457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7fa3-1e42-407f-bd47-81b6df46b4a9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:43.600996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 32/62] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:43.606443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147af7a-4b8c-42fc-91a8-5d6bcf701359 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:43.607210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147af7a-4b8c-42fc-91a8-5d6bcf701359 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:43.607649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147af7a-4b8c-42fc-91a8-5d6bcf701359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:43.633689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8147af7a-4b8c-42fc-91a8-5d6bcf701359 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:43.635121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8147af7a-4b8c-42fc-91a8-5d6bcf701359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:43.645814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:43.731137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 31/63] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:43.774342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead7fa3-1e42-407f-bd47-81b6df46b4a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:43.895990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b643-a1b1-4160-b00c-45f9bf242092 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:43.896277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b643-a1b1-4160-b00c-45f9bf242092 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:43.896463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b643-a1b1-4160-b00c-45f9bf242092 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:43.898077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 32/64] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:57:43.903772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3498-ad2d-44e5-ba58-40d9f7627ae3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:43.904490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3498-ad2d-44e5-ba58-40d9f7627ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:43.904998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee3498-ad2d-44e5-ba58-40d9f7627ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:43.933805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ebee3498-ad2d-44e5-ba58-40d9f7627ae3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:43.935455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ebee3498-ad2d-44e5-ba58-40d9f7627ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:43.946042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead7fa3-1e42-407f-bd47-81b6df46b4a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.011084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.011737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.012020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.012295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.030457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:44.038523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:44.038763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:44.039797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:44.040807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 33/66] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:44.042972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330b02-5664-4253-9dbb-86434e28f36d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.043390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330b02-5664-4253-9dbb-86434e28f36d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.043807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330b02-5664-4253-9dbb-86434e28f36d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.045365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 34/67] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:44.050942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.051402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.052382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.053251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.091074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.094935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:44.096001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:44.193978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 35/68] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:44.197502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.203807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.209774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c18b7-8629-4472-b351-dc72fa5f6890 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.250258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.251118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.251584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.251858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.252749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:44.253198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.255305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544e7e6-11aa-404b-b5cb-2f4ad931d8af None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:44.265139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:44.267489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2df2-f4bf-40ce-8db4-2b899ac76732 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.268208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2df2-f4bf-40ce-8db4-2b899ac76732 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.268614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2df2-f4bf-40ce-8db4-2b899ac76732 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.270910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 35/70] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:44.273612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a2df2-f4bf-40ce-8db4-2b899ac76732 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.322039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ce94-9c51-42a8-bfaa-1d72cfdeed0b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.358974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.359717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.360000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.360270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.368320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.372485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:44.377746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:44.378676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:44.379420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:44.380121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.391594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a2df2-f4bf-40ce-8db4-2b899ac76732 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.428908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.429578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.429863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.430139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.440805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d5865640-8ddc-4211-a9d6-ad5c989f03f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:44.446388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:44.447275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:44.448034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 36/72] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:44.448822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f50c-d5b6-45c1-b742-7d0cb03d95e5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.449016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f50c-d5b6-45c1-b742-7d0cb03d95e5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.449320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f50c-d5b6-45c1-b742-7d0cb03d95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.453184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.467136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8429f50c-d5b6-45c1-b742-7d0cb03d95e5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:44.468361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8429f50c-d5b6-45c1-b742-7d0cb03d95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:44.492137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81c8d-2a9b-4471-bf09-1070fcfe836b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.531220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.532337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.532882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.533363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.543911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 37/73] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:44.545523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b310-9a33-463a-ada3-6fd18cdce0e8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.545818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b310-9a33-463a-ada3-6fd18cdce0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.546115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3b310-9a33-463a-ada3-6fd18cdce0e8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.547554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 38/74] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:44.548099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3b310-9a33-463a-ada3-6fd18cdce0e8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.553212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.555222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:44.557060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:44.557910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.635231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.658957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3b310-9a33-463a-ada3-6fd18cdce0e8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.670916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15d99d-a98b-4625-980e-842c05693751 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.694645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.694885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.695270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.695560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.695886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.696973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:44.697233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.698622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fd21e-731c-4b9e-b2ac-13ca74f7872c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:44.707284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 39/76] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:44.708857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.709109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.709381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.710381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.711014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.711295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.711564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.712417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:44.712579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.714004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:44.723531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 38/77] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:44.724455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.728826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:44.730046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:44.799416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 40/78] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:44.800379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.842008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690069d-1054-4358-ab90-a4da19b04d65 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.872724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.884450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.885588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.886090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.886381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.912056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cd4e6-1b87-4ea3-83dd-381f8306eaff None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:44.947857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:44.948407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:44.948705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:44.948979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:44.950112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.951528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:44.953140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 41/79] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:44.953374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:44.953916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:44.973120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:44.974606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.058101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe95-2293-4f88-b979-eee013baeaff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.077156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 39/80] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:45.078020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.111143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.111795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.112076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.112352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.113634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.115151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.116709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 42/81] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:44 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:45.117484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.124775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.177181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.197601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8dba0-bd3a-4358-9372-5ed6b624aa5a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.234946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.235507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.235839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.235922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714a4b8-25bc-4bb5-adc0-7e2e26c5b0fb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.236400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.237634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.239816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.241486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 40/82] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:45.242232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.284037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165370-b642-418b-930e-606de6da40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.285666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165370-b642-418b-930e-606de6da40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.285953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165370-b642-418b-930e-606de6da40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.286225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165370-b642-418b-930e-606de6da40d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.296423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91165370-b642-418b-930e-606de6da40d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-91165370-b642-418b-930e-606de6da40d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:45.301980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:45.302836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:45.303594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 43/83] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:45.304721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165370-b642-418b-930e-606de6da40d9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.356825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce8618-edc9-4d43-9c10-1d9cc7cf4719 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.368766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.393115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804937ac-df02-408b-9251-150c246b6beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.393745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804937ac-df02-408b-9251-150c246b6beb None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.394024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804937ac-df02-408b-9251-150c246b6beb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.394323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804937ac-df02-408b-9251-150c246b6beb None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.395008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804937ac-df02-408b-9251-150c246b6beb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.396465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804937ac-df02-408b-9251-150c246b6beb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.406004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165370-b642-418b-930e-606de6da40d9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.418486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 41/84] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:57:45 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:45.419327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804937ac-df02-408b-9251-150c246b6beb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.437632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.452103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.453331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.453825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.454307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.456393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.459609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.461464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 44/85] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:45.462264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.554842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804937ac-df02-408b-9251-150c246b6beb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.588305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500bc8-6dd7-4890-86a7-a232d95eefad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.599224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.599873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.600164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.600442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.626044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.632514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:45.633176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:45.633922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:45.634230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:45.698807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.700297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.713868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.734966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:45.736547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:45.846772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 42/86] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:45.848919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.875363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 45/87] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:45.875363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:45.918890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:45.974020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5a87-d9b5-4a2b-a698-ffbdf93d2c8f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:45.984555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:46.003243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395143-580a-42ad-8faa-ecb2d2cfe8fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.011495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.012291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.013042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.013042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.014153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:46.014559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.016055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.025924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 43/88] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.026832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.046644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.047497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.048013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.048524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.049653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:46.050106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.051733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.058304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 46/89] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:45 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=f51ffc831d584368858aa77465ba49ed => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.059627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.140736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8fd8c-2614-4d79-b50f-2d2f47df7ada None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.178878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.179709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.180094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.180461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.181797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.182137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:46.183452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.185269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 44/90] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.186351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.192688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73250e-a213-413b-b0a6-69e20437e325 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.231172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:46.262828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.263734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.264142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.264579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.269457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.271111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.273108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 47/91] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.274090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.301166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66250c-5fd0-4a86-82f1-9175e7bdc13b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.342950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.343833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.344712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.345095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.346664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.348731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.351184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 45/92] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.352173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.473346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbd421-2a58-482e-b9a8-d7948b14a04e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.481865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:46.512144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.512989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.513362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.513744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.514927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=03e8dd2f02b7463797c3e9d1f831c5fd) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:46.515378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.517257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.523578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 46/93] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/role_assignments?user.id=03e8dd2f02b7463797c3e9d1f831c5fd&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.524507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.528188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db945b1-f794-42cb-9a38-1e597cb78e14 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.602955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.603573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.603856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.604127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.604962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:46.605270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.606858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.622017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 48/94] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:46.648006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029e3fe-cd71-47a7-a924-97ca9fa6409a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:46.687698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:46.688356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:46.688688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:46.688939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:46.740290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:46.778810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:46.780311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:46.905835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 47/95] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:46.913060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:46.950687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:47.032901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd7d41-b21e-4d47-a67e-f54f3fae1f20 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:47.068550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:47.069266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:47.069547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:47.069822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] PATH_INFO: `/v3/projects/44036285234d474c8c24ebff525b49ca` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:47.070988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] RBAC: Authorizing `identity:get_project(project_id=44036285234d474c8c24ebff525b49ca)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:47.072422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc7a78-6b18-4b91-9970-9531f129b65e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:47.074129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 49/96] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:46 2022] GET /identity/v3/projects/44036285234d474c8c24ebff525b49ca => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:47.080606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:47.163257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:47.187645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff922e-3a15-4c5d-8a5d-556d7f3f948a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:47.226969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:47.227602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:47.227883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:47.228157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:47.229065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=44036285234d474c8c24ebff525b49ca, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:47.229618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:47.231067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994ce17-9372-4ccf-922f-186582a7a194 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:47.237118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 48/97] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:47 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=44036285234d474c8c24ebff525b49ca&role.id=f51ffc831d584368858aa77465ba49ed => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:48.198450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8182c-670b-493c-95d2-60d8fc5ec8f4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.198975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8182c-670b-493c-95d2-60d8fc5ec8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.198975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8182c-670b-493c-95d2-60d8fc5ec8f4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.200601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 50/98] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:48.206585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af7f6-4d2b-442a-978b-14b6efbcfe4c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.207098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af7f6-4d2b-442a-978b-14b6efbcfe4c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.207171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0af7f6-4d2b-442a-978b-14b6efbcfe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.228606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fe0af7f6-4d2b-442a-978b-14b6efbcfe4c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:48.233977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fe0af7f6-4d2b-442a-978b-14b6efbcfe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:48.328088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 49/99] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:48.378374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8182c-670b-493c-95d2-60d8fc5ec8f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:48.496696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:48.506495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8182c-670b-493c-95d2-60d8fc5ec8f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:48.530266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6cc-cc32-4ba3-a2c3-e225d3403e77 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.530589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6cc-cc32-4ba3-a2c3-e225d3403e77 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.530844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6cc-cc32-4ba3-a2c3-e225d3403e77 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.532424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 50/100] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:48.546137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.546447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.546703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.579243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:48.580498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:48.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:48.591909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.592198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.592482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.616951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:48.622358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:48.623188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:48.623946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 51/101] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:48.630390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:48.792760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74470-c8e0-4e49-8a3a-d6d09c06db8f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:48.796145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:48.812691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 51/102] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:48.864467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:48.865125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:48.865408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:48.865684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:48.866407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:48.866714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:48.868105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:48.874463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:48.880588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 52/103] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:48.886158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:48.922213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:49.008044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f33b91-9fe2-4078-9be1-21eaca668396 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.052367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.053313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.053753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.054191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.061434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.062917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:49.064935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 52/104] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:49.070557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:49.071344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f02a-3d21-4707-a996-4e908ac2cb92 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.130114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.131340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.131832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.132308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] PATH_INFO: `/v3/users/db8249c51c2f4460b762e4ab312d8369` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.153358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:49.164051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=db8249c51c2f4460b762e4ab312d8369)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.165893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:49.168048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 53/105] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:48 2022] GET /identity/v3/users/db8249c51c2f4460b762e4ab312d8369 => generated 289 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:49.173781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:49.194374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700d637-417e-4abb-be01-9881b5935b4d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.235309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.236678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.239188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.239628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.240486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.242121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:49.279693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 53/106] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:57:49 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:57:49.305018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:49.330450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c55b2-5f68-435d-a1c9-55937940e6c4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.370575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.371297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.371585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.371862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.447903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.449333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0364737-a909-403f-87d6-f1ee1cdc900b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:49.533413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:49.562022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 54/107] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:57:49.573197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:49.701915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b85f-b463-41cd-b520-9864c004466c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.715459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb52f-cddf-451d-a430-7d8bbeff1cea None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.715779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb52f-cddf-451d-a430-7d8bbeff1cea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.716012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb52f-cddf-451d-a430-7d8bbeff1cea None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.717556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 55/108] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:57:49.724274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482a6-e93e-4578-99a0-fc55d3832cfe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.724883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482a6-e93e-4578-99a0-fc55d3832cfe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.725362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482a6-e93e-4578-99a0-fc55d3832cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.737034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:49.748408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a5d482a6-e93e-4578-99a0-fc55d3832cfe None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:49.750951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a5d482a6-e93e-4578-99a0-fc55d3832cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:49.785357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.786042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.786324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.786599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.788616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.790145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:49.791871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 54/109] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:49 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:49.798009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:49.894758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 56/110] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:49.896102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbdb6-8536-44c9-b3ac-fe5ac0a5407e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.896358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbdb6-8536-44c9-b3ac-fe5ac0a5407e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.896654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbdb6-8536-44c9-b3ac-fe5ac0a5407e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.898090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 57/111] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:49.903391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2d43-7518-4047-915f-899bab686f0b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.903681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2d43-7518-4047-915f-899bab686f0b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.903965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2d43-7518-4047-915f-899bab686f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.943253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-385a2d43-7518-4047-915f-899bab686f0b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:49.944477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-385a2d43-7518-4047-915f-899bab686f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:49.949417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f68dec-c303-4021-ad6e-f151c025283f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:49.992836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:49.993444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:49.993731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:49.994040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:49.995536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=db8249c51c2f4460b762e4ab312d8369) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:49.995862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:49.997358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:50.003731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 55/112] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:49 2022] GET /identity/v3/role_assignments?user.id=db8249c51c2f4460b762e4ab312d8369&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=9b408d867b4f460cad1fde6a4626251f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:50.005244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.080202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.116763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 58/113] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:50.118320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce38bb3-7e9e-4b08-9b61-9a5f07a660dc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.118760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce38bb3-7e9e-4b08-9b61-9a5f07a660dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.119200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce38bb3-7e9e-4b08-9b61-9a5f07a660dc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.120662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 59/114] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:50.130782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.131264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.131719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.153748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:50.155208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:50.174756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a039cf-ae3d-4233-b149-9132103f9ae4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.201001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.242606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.243392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.243565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.243834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.265000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:50.271277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:50.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:50.273075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:50.274167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 56/115] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:50.277703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 60/116] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:50.278612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.279742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.423921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed3f8a-7401-4a34-bf59-c86f080041ed None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.429891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cd387-c6d7-472c-b30a-660b263d665a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.438510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.469430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.469984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.470128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.470319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.470591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.471208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.471324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:50.471599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:50.471891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.472328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.473323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882deb-75d1-492e-b821-19bd3fb2ff6f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:50.484328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 61/117] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:50.486046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:50.486204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a761c3-9352-4c14-a334-29ed8e5b2f0a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.486473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a761c3-9352-4c14-a334-29ed8e5b2f0a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.486743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a761c3-9352-4c14-a334-29ed8e5b2f0a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.488135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 62/118] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:50.492092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a761c3-9352-4c14-a334-29ed8e5b2f0a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:50.496401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:50.497383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:50.498141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:50.500627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 57/119] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:50.501775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.524223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.618343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a761c3-9352-4c14-a334-29ed8e5b2f0a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.640684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd4e2e-2bb5-4d33-ba23-160928079fdc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.661459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.662817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.663485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.663968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.678555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:50.684273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.684986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.685274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.685549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:50.686669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:50.687677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:50.688532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:50.689157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:50.689157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415adc0b-522c-49ef-b75a-2e281521f2bc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:50.689822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 58/120] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:50.690980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.691832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.692109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.697144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 63/121] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:50.698403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.712535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:50.714177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:50.760000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.803620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:50.820023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c98e19-1199-4b45-9ebd-972a6c6c9e1e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:50.827450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 59/122] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:50.832688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.884211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:50.885165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:50.885605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:50.886092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:50.887085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:50.887564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:50.889244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:50.900338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 64/123] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:50.901593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:50.952237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f212bfd-12e1-4db2-88b9-3f4dd185e057 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.001563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.002326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.002708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.002997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.005724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.007199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.009010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 60/124] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.009793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.044045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.052496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c697f9-64c3-4bef-a7d0-4c2544417fc0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.099822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.100780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.101274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.101791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.102716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:51.103218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.104975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.115515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 65/125] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:57:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.116692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.131177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6a38b-fc10-4d74-8168-5ce7f09e73ee None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.133805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.174106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.175349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.176720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.177277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.192825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:51.200461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:51.201462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:51.202269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:51.205138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 61/126] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:51.206172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.240407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84604-883d-4e5a-974b-83dcc02051aa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.277856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.278511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.278792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.279073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.280260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.281828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.283524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 66/127] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.284300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.342460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.359078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e2d5-2fec-42fc-9b4f-fd47535bfec2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.393480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.404156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.405461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.405461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.405752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/03e8dd2f02b7463797c3e9d1f831c5fd/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.408018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, user_id=03e8dd2f02b7463797c3e9d1f831c5fd, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.409696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.420204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511476b-ea24-47b7-b37d-7f1255104a86 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.429110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 62/128] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:57:51 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/03e8dd2f02b7463797c3e9d1f831c5fd/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:57:51.430897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.465321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.466665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.467113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.467565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.469198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.471162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.473538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 67/129] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.474780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.576367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bbd24-d878-45be-8abb-67376433091a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.622357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.623035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.623660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.624017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.624872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:51.625254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.626753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.638933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 63/130] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.640022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.661885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.698745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea2ee-878e-4b58-84d8-0d8b411f52c1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.744297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.744981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.745264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.745537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.746798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.748265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.750011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 68/131] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.759536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.770213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7498e5-479f-492b-942f-5e03be6b0aca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.782135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.821383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.822524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.822816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.823100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:51.824734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:51.826836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:51.828919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 64/132] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:51.829748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:51.935099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:51.953268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03694cb5-95c7-42b2-bbd2-dc957b3094cb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.973687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6166920-7951-47da-8cfe-28aa03b3d02a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:51.997558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:51.998253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:51.998538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:51.998816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/0b6c84a7425943188e140f26883d6fb7/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.001644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, user_id=0b6c84a7425943188e140f26883d6fb7, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.003314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.013978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:52.015163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.015780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.016273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.017829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.020469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 65/133] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:57:51 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/0b6c84a7425943188e140f26883d6fb7/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:57:52.021101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb75b6-bcde-4fd3-97e6-cba8aeb43165 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.021309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.023413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 69/134] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:51 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:52.029821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05180e-a787-40dd-a340-d415fae25113 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.030495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05180e-a787-40dd-a340-d415fae25113 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.031079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05180e-a787-40dd-a340-d415fae25113 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.032875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 70/135] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:52.034048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05180e-a787-40dd-a340-d415fae25113 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.175062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60efa5-1e67-4a2e-b7a2-46b78ab845fa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:52.224260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:52.231052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:52.232234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.232903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.233386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/0b6c84a7425943188e140f26883d6fb7/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.236846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, user_id=0b6c84a7425943188e140f26883d6fb7, role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.239406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a694c-363e-46c6-819d-5383af6dde39 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.266261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 66/136] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:57:52 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/0b6c84a7425943188e140f26883d6fb7/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:57:52.268046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.272672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.272855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05180e-a787-40dd-a340-d415fae25113 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:52.274109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.292500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:52.321841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:52.323138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:52.354487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:52.355360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.355804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.356175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] PATH_INFO: `/v3/projects/44036285234d474c8c24ebff525b49ca` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.360832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] RBAC: Authorizing `identity:get_project(project_id=44036285234d474c8c24ebff525b49ca)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.366290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.369797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 71/137] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:52 2022] GET /identity/v3/projects/44036285234d474c8c24ebff525b49ca => generated 312 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:52.401091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.497098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 67/138] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:52.527134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.599635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884f2d-72ad-4aa3-ad2d-37c18dde542f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:52.652954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:52.654046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.654395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.654739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] PATH_INFO: `/v3/projects/44036285234d474c8c24ebff525b49ca/users/0b6c84a7425943188e140f26883d6fb7/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.656784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] RBAC: Authorizing `identity:create_grant(project_id=44036285234d474c8c24ebff525b49ca, user_id=0b6c84a7425943188e140f26883d6fb7, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.658304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0f349-52f1-4ebb-9d3b-1018d084fa40 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.673035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f332-fdb6-497f-8241-8088b2e8aebe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:52.675446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 72/139] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:57:52 2022] PUT /identity/v3/projects/44036285234d474c8c24ebff525b49ca/users/0b6c84a7425943188e140f26883d6fb7/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:57:52.680708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6f8b-50a5-4f15-a0df-bf8dc3926d72 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.680708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6f8b-50a5-4f15-a0df-bf8dc3926d72 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.680708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6f8b-50a5-4f15-a0df-bf8dc3926d72 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.680708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 73/140] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:52.688949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.688949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.688949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.710464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:52.711781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:52.723854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:52.746119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:52.763160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:52.763812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:52.764094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:52.764368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:52.766699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:52.768415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:52.770345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 68/141] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:52.777768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.882653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 74/142] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:57:52.917031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:52.984255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f973-ecc3-4667-bc84-7f67752391d3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.061873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.062510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.062787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.063061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.063751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:53.065847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:53.117441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2d3b-db32-4919-8f14-09b1e745c0a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.120150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 69/143] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:57:52 2022] POST /identity/v3/users => generated 283 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:57:53.159882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.161083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.161352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.161619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.173871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:53.180233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:53.181241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:53.182003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:53.182589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 75/144] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:53.188351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:53.266155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:53.322200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c99e-cee5-4672-ad07-fca1de5bd108 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.369119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.369766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.370045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.370315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.371037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:53.371342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:53.372742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:53.383295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 70/145] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:53.389260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:53.392818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:53.500425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e4ca-93eb-4833-9120-45a1e2158a79 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.539250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.539899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.540177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.540448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] PATH_INFO: `/v3/users/db8249c51c2f4460b762e4ab312d8369` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.541753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] RBAC: Authorizing `identity:get_user(user_id=db8249c51c2f4460b762e4ab312d8369)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:53.543313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:53.545020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 76/146] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:53 2022] GET /identity/v3/users/db8249c51c2f4460b762e4ab312d8369 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:53.552411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:53.686075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352beaf-eb85-4fd1-81b5-019a457867ee None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.716923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:53.743101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.743768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.744045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.744316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.745862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:53.747336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fbddf-9c33-4b62-b15a-17e7b5013799 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:53.749043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 71/147] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:53 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:53.756321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:53.834330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:53.869241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942ea03-f37c-4429-8b96-9fb92b7b3768 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:53.906558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:53.907240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:53.907518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:53.907790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/db8249c51c2f4460b762e4ab312d8369/roles/9b408d867b4f460cad1fde6a4626251f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:53.909910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, user_id=db8249c51c2f4460b762e4ab312d8369, role_id=9b408d867b4f460cad1fde6a4626251f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:53.911371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df165e-3db8-466b-b372-dc9d1a8f8e78 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:53.931619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 77/148] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:57:53 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/users/db8249c51c2f4460b762e4ab312d8369/roles/9b408d867b4f460cad1fde6a4626251f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:57:54.242126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a6b-68b3-4823-905f-ec3d50dd735b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:54.242482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a6b-68b3-4823-905f-ec3d50dd735b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:54.242675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a6b-68b3-4823-905f-ec3d50dd735b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:54.244311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 72/149] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:54.249787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:54.250081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:54.250326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:54.272010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:54.273216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:54.358011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 78/150] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:54.411094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0a6b-68b3-4823-905f-ec3d50dd735b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:54.541697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0a6b-68b3-4823-905f-ec3d50dd735b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:54.585256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:54.586025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:54.586334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:54.586645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:54.608609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:54.614852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:54.615766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:54.616595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 73/151] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:54.623855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:54.700508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:54.760394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3704-0f2d-45cf-8537-8d4c83a72627 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:54.813908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:54.814539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:54.814820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:54.815088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:54.815887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:54.816977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:54.818371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:54.834507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 79/152] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:54.840486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:54.913470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:54.977616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7860d1-24cd-4bc9-9c13-fe85501ef7c0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:55.015083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:55.016071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:55.016553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:55.017074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] PATH_INFO: `/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:55.018435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] RBAC: Authorizing `identity:get_user(user_id=03e8dd2f02b7463797c3e9d1f831c5fd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:55.021521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:55.023372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 74/153] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:54 2022] GET /identity/v3/users/03e8dd2f02b7463797c3e9d1f831c5fd => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:55.029220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:55.200691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf2109-9381-4b55-a689-083c42345c70 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:55.242451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:55.258584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:55.259213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:55.259489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:55.259757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:55.348541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:55.350088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52cdc4-475f-4135-84aa-2bd8ff86bcf6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:55.483749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 80/154] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:55.491467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:55.602991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6c8f1-ddfa-4af2-b95d-d77a2f10ab35 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:55.603266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6c8f1-ddfa-4af2-b95d-d77a2f10ab35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:55.603689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6c8f1-ddfa-4af2-b95d-d77a2f10ab35 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:55.605518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 81/155] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:55.619142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:55.619775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:55.620248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:55.654109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:55.655661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:55.680727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40830b21-c326-4e49-91b5-21b676e15dda None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:55.694892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:55.711169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:55.760234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:55.760850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:55.761132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:55.761403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:55.762576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:55.764024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:55.765892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 75/156] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:55 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:55.772413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:55.793663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 82/157] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:55.844403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:55.973187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea16d1a-07f4-42cf-9b22-53434c6be2cf None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:56.021104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:56.021986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.022404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.022845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.023094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d397b1-57ad-4d6e-b669-ffa5394c8d41 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:56.023932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=03e8dd2f02b7463797c3e9d1f831c5fd) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:56.024384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:56.026248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:56.034329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 76/158] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:55 2022] GET /identity/v3/role_assignments?user.id=03e8dd2f02b7463797c3e9d1f831c5fd&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:57:56.098883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:56.099548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.099821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.100086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.121363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:56.126412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:56.127283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:56.128314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 83/159] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:57:56.135609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:56.209941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:56.277319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de61c-ff39-4441-9050-1b9b1093627e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:56.318384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:56.319026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.319301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.319570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.320301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:56.320602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:56.322048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae096-727f-4821-9312-6a2898cc8127 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:56.336801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 77/160] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:56.342468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:56.375737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:56.445462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e965f-6454-4091-a3f1-7a4b2dd22ae7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.445730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e965f-6454-4091-a3f1-7a4b2dd22ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.446016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e965f-6454-4091-a3f1-7a4b2dd22ae7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.447826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 78/161] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:56.459050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.459350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.459606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.491356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:56.492566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:56.521265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4943d8-bc3b-419a-bbd2-ecfe36cfd4ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:56.584538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:56.585583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.586063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.586634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.588055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:56.589750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:56.591647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 84/162] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:56 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:56.603440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:56.623211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 79/163] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:56.679633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:56.758600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:56.760237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:56.814004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de438-2321-491f-8711-42ebd4701f3d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:56.906962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:56.907937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:56.908352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:56.908819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:56.926624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c552da-606a-42c8-b8ce-70192c689e70 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:57.016615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:57.017316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.017598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.017867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.048036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-80ae839b-b95b-4d25-b0ea-007b10a3cc99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:57.053642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:57.054496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 80/164] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:57.056093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc706-3a97-4055-b40d-39e6d5d214f6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.057094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc706-3a97-4055-b40d-39e6d5d214f6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.057094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc706-3a97-4055-b40d-39e6d5d214f6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.064344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 81/165] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:57.067908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc706-3a97-4055-b40d-39e6d5d214f6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:57.085675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:57.087388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53f96-6044-4a95-acb3-ff8c4db20211 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:57.184866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:57.203124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 85/166] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:57:57.204230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.204517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.212989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.242365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:57.244293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:57.358732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:57.373720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 86/167] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:57.374092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc706-3a97-4055-b40d-39e6d5d214f6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:57.374592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:57.481471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:57.482047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.482371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.482648 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.483388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:57.483694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:57.485155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:57.498802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 82/168] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:57.499669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:57.575628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8ce93-8a66-47f0-b900-73a08b12f2b2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:57.601035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:57.643641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:57.644931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.645304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.645568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.653567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:57.655058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:57.657056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 87/169] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:57.657632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:57.730220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae3137-68c1-417f-8f0e-755924fa4dad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:57.821402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:57.822884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.823409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.823877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.843463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:57.857076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:57.858030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:57.858814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:57:57.861300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 83/170] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:57.862375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:57.871229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb07e-c107-43cc-8012-35e3106ae510 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:57.929636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:57.971871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:57.972962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.974013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.975309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.979394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:57.981177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ecfbc-5f83-4402-99fd-868f94f35d26 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:57.985421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 88/171] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:57.988695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66213-99dc-4557-ac64-c91984a0d359 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:57.993447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66213-99dc-4557-ac64-c91984a0d359 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:57.993956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc66213-99dc-4557-ac64-c91984a0d359 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:57.995532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 89/172] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:57.996467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc66213-99dc-4557-ac64-c91984a0d359 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.109733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ca87b-18c1-49e8-bf1d-4927c661a2eb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.125043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.186668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.187558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.188013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.188903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:58.190617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:58.193365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:58.202035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 84/173] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=f51ffc831d584368858aa77465ba49ed => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:58.203071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.214747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc66213-99dc-4557-ac64-c91984a0d359 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.301104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.301742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.302015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.302277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.302996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:58.303382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:58.305080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db016c-0bce-4207-aad4-4603343604bd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:58.315692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.324015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 90/174] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:58.330183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eff07-941d-4fbe-9d72-b95ad542fede None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.330684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eff07-941d-4fbe-9d72-b95ad542fede None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.330855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12490a9b-39d6-4344-a393-af5a076c8b0a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.331243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eff07-941d-4fbe-9d72-b95ad542fede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.367665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-512eff07-941d-4fbe-9d72-b95ad542fede None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:58.368819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-512eff07-941d-4fbe-9d72-b95ad542fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:58.424964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.426604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.427308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.427899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.494336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 91/175] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:58.495900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a26a-6a4a-4536-b43b-aa72e04670a9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.496416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a26a-6a4a-4536-b43b-aa72e04670a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.496884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689a26a-6a4a-4536-b43b-aa72e04670a9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.502337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 92/176] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:58.504120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689a26a-6a4a-4536-b43b-aa72e04670a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.535115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:58.537924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaeefb-b6e6-4ffd-bf51-ba5fcfb898cb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:58.564491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.644317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.646490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689a26a-6a4a-4536-b43b-aa72e04670a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.665641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 85/177] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:58.666916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db59f-46e4-4a83-a574-f058d60ceec3 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.667199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db59f-46e4-4a83-a574-f058d60ceec3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.667470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915db59f-46e4-4a83-a574-f058d60ceec3 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.672441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 86/178] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:58.672441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.672441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.672441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.692429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.693956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.694406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.694987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] PATH_INFO: `/v3/users/0b6c84a7425943188e140f26883d6fb7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.695151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:58.696369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:58.697674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] RBAC: Authorizing `identity:get_user(user_id=0b6c84a7425943188e140f26883d6fb7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:58.699109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19ad1f-36a1-4750-859b-4c2ab6aa41ef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:58.700751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 93/179] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:58 2022] GET /identity/v3/users/0b6c84a7425943188e140f26883d6fb7 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:58.703150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee000-b265-4481-890a-3757816a4c6f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.703431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee000-b265-4481-890a-3757816a4c6f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.703685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ee000-b265-4481-890a-3757816a4c6f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.705718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 94/180] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:57:58.706676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ee000-b265-4481-890a-3757816a4c6f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.772461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 87/181] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:58.773350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.839474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ee000-b265-4481-890a-3757816a4c6f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.847090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.876634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.877323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.877323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.877658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.888966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:58.889554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909c732-b153-4056-ad50-fd7c5ddd1f3f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b1bcd864-e544-496a-9a55-6e4fede2fa24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:58.894263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:58.895228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 95/182] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:58.900451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530f91-3c3c-47ae-95b8-d209f1894170 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.901333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530f91-3c3c-47ae-95b8-d209f1894170 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.901333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12530f91-3c3c-47ae-95b8-d209f1894170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.911884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:58.915311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-12530f91-3c3c-47ae-95b8-d209f1894170 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:58.916520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-12530f91-3c3c-47ae-95b8-d209f1894170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:58.948657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:58.949316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.949594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.949862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] PATH_INFO: `/v3/projects/44036285234d474c8c24ebff525b49ca` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:58.951039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=44036285234d474c8c24ebff525b49ca)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:58.952473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:58.954179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 88/183] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:58 2022] GET /identity/v3/projects/44036285234d474c8c24ebff525b49ca => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:58.954946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:58.991401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 96/184] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:58.992829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:58.993115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:58.993384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.011358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:57:59.012752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:57:59.076518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0f445-775a-4b11-896b-f1009f0d3ce9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.092540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 97/185] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:57:59.093646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.120679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.121309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.121674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.121992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.128024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.179111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.201368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.205913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.213126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35f9a-e47f-482f-9842-ffeb905c591a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.248271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.248948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.250522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.250522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.259984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:59.264937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:59.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 98/186] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:59.270520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.327182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 89/187] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:57:59.328055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.368493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.384721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaaea5-3c3a-4944-8780-35e0d2dbd731 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.423724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.423928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.424343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.424616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.424909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.425656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:59.425952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.427338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.435878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 99/188] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:59.436626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.444810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ca66-f527-4732-b569-fceae8c597af None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.481194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.481815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.482091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.482368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.483161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=44036285234d474c8c24ebff525b49ca, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:59.483463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.484943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.490923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 90/189] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=44036285234d474c8c24ebff525b49ca&role.id=f51ffc831d584368858aa77465ba49ed => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:59.491714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.563724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c4831-89e8-4283-a60f-1bbb509872d1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.606249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.607208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.607489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.607765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.620888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:57:59.626359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:57:59.627475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 100/190] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:57:59.634335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.645020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180377-23fc-4873-ad47-911e96d2520d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.648176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.694398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.695713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.696176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.696531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.698230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.702743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.702743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 91/191] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:59.703578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.725708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.781045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db3707-b9f0-459b-8449-3feb98a5eebe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.833468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dedce-d7ee-400e-9b00-a5094e07be46 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.833676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.834117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.834394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.834663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.835396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:57:59.835699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.837119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.849044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 101/192] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:59.850328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.875556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:57:59.876211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:57:59.876491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:57:59.876787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:57:59.878000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:57:59.880089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:57:59.881817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 92/193] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:57:59.882581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:57:59.951660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:57:59.985603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8995-ecd2-484a-8e68-03c3fa07f83b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:57:59.991561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.017271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443020-0703-4b16-8805-7a65170f0381 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.029262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.029897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.030173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.030440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.053175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.056013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.057873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.058509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.058784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.059056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.059140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 102/194] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:00.059794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:00.060100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.061517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.062314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.071053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 93/195] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:00.075944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.196521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb299e-b25f-4298-a85d-f5e4fa21cd4a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.198382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432e126-cff8-40a6-aec4-d2b443feb860 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.234177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.234505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.235159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.235433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.235702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] PATH_INFO: `/v3/users/db8249c51c2f4460b762e4ab312d8369` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.236947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] RBAC: Authorizing `identity:get_user(user_id=db8249c51c2f4460b762e4ab312d8369)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.238966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.240595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 94/196] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/users/db8249c51c2f4460b762e4ab312d8369 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:00.245621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.246489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.247124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.247399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.247668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.248362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.249830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.269066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.284027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 103/197] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:00 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:00.285653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.416222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43a8c9-3025-4a2b-afe7-1c27e2fd5c9c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.447775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035090f-d299-41f6-86bf-bfd37c70ccf1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.464375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.465059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.465341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.465606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.466402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=0b6c84a7425943188e140f26883d6fb7) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:00.466712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.468190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.477502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 95/198] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/role_assignments?user.id=0b6c84a7425943188e140f26883d6fb7&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:00.480100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.496102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.496357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.496726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.497696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.581106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.608479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.610036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.638689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.691817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5406f5-029f-4c93-9829-6f42018f9d3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.747037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.747037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.747037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.747037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.748220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:00.749809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:00.752101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 96/199] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:00.756173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.784047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 104/200] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:00.785680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:00.900475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463adaf-e439-4867-8b0c-ddebaf1a616e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.902277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.920888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15973b2-c871-4ccd-9c4c-2ca62ab5a812 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:00.945504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.946140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.946461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.946733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:00.964337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:00.965871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:00.966639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:00.967434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:00.967724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.023822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.025360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.092137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.099352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.143163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 97/201] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:01.148998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.219416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:01.227703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:01.250219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 105/202] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:01.251662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.306137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460f8d-302d-427a-9026-fca7a4e6dce8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.366748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.369492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.370100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.370927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.372598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.374353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.375136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012de04-c5c0-40a3-b838-3c69e49ba1e4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.376785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 98/203] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:01.381801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.423612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.423612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.423612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.424591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.427165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.428691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.432759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 106/204] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:01.432759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.518649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32909e5f-2d6b-4fd1-9c2a-3abc89ff4614 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.538002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:01.538569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:01.566386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.567496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.568085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.568584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.570139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.571925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.579046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 99/205] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:01.580163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.588509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e7d9-7f1e-4c88-83e1-b0c34896b3d6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.623243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.623868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.624156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.624450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.625290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=39db2ce3f4e74f70a97534d0bd9ff068) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:01.625599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.627297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.640669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 107/206] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/role_assignments?user.id=39db2ce3f4e74f70a97534d0bd9ff068&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:01.640669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:01.744678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426240-2aea-4497-9c8f-19acab006fd9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.753254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74ed7-8cd4-48d0-acc6-eec297c756fc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:01.761410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:01.798122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.798781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.799061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.799330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.800138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=39db2ce3f4e74f70a97534d0bd9ff068) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:01.800480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.801998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a446d-48d5-4c27-afd7-ad51a143a457 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.815209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 108/207] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/role_assignments?user.id=39db2ce3f4e74f70a97534d0bd9ff068&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:01.842882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:01.843466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:01.843749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:01.844027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:01.844892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141, user.id=db8249c51c2f4460b762e4ab312d8369) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:01.845208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:01.846770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13820-9b0c-4542-bba5-02f1466f5b5c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:01.859506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 100/208] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:01 2022] GET /identity/v3/role_assignments?user.id=db8249c51c2f4460b762e4ab312d8369&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=9b408d867b4f460cad1fde6a4626251f => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:02.817674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecd-73a2-4791-9038-247a4587b5d8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:02.818193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecd-73a2-4791-9038-247a4587b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:02.818193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecd-73a2-4791-9038-247a4587b5d8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:02.819900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 109/209] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:02.825317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:02.825748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:02.825924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:02.845753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:02.846949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:02.878869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0334-e435-4bcf-9eba-a7075d381754 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:02.879507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0334-e435-4bcf-9eba-a7075d381754 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:02.880139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0334-e435-4bcf-9eba-a7075d381754 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:02.882334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 110/210] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:02.888805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:02.889355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:02.889853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:02.895002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:02.914361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:02.915882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:02.932683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 101/211] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:02.954803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:02.997877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 111/212] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:03.022976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:03.068989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5640-d56b-4c4b-af8e-22c42ad2dc1b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.121377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.122348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.122764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.123171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:03.124472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:03.126281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:03.134088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 102/213] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:03.143741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:03.176862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512fa83-4ae4-4c3b-9fa5-49127a69917f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.192010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:03.211751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:03.223152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.224044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.224466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.224908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:03.238716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:03.245117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:03.246201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:03.246991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:03.249705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 112/214] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:03.257203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:03.287024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e264b2-3067-4b8c-bf63-d2546ae32eaa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.338876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.339399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.339681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.339956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:03.340761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:03.342440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:03.369675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 103/215] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:03 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:03.410198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642188-b452-4509-8b00-15921dfc9373 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.472480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.473560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.474057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.474528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:03.475467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:03.475976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:03.477662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:03.488393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 113/216] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:03.498027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:03.619383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:03.624081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b36e63-bf76-4c4b-9524-62d0cd2d287d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.674756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.675960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.676247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.676530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] PATH_INFO: `/v3/users/bef3105cb8a54d098376053c392d38d6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:03.693868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] RBAC: Authorizing `identity:get_user(user_id=bef3105cb8a54d098376053c392d38d6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:03.695579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f6b61-b0e0-487c-a3bc-877b5b4d28e2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:03.698014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 104/217] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:03 2022] GET /identity/v3/users/bef3105cb8a54d098376053c392d38d6 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:03.704885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:03.750223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:03.862592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5ed2-96eb-4748-9a0d-f188f8597f5c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:03.907853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:03.908512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:03.908820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:03.909100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.007377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:04.008844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c869fe-cd67-445a-bf75-32c56f090c03 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:04.051177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1aeb-5b30-4d2f-a4a3-e75f51127d0b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.051730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1aeb-5b30-4d2f-a4a3-e75f51127d0b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.051730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1aeb-5b30-4d2f-a4a3-e75f51127d0b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.053248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 105/218] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:04.063324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125607a6-1650-4196-b9fa-201bb1d1a728 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.063603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125607a6-1650-4196-b9fa-201bb1d1a728 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.063868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125607a6-1650-4196-b9fa-201bb1d1a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.077860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:04.093712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-125607a6-1650-4196-b9fa-201bb1d1a728 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:04.094941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-125607a6-1650-4196-b9fa-201bb1d1a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:04.179014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 114/219] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:04.180540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47463e-3d76-454a-87ce-412f4d2516b9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.180982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47463e-3d76-454a-87ce-412f4d2516b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.181389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47463e-3d76-454a-87ce-412f4d2516b9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.182794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 115/220] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:04.184202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47463e-3d76-454a-87ce-412f4d2516b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.195781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 106/221] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:04.197323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.197755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.198174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.228523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:04.230114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:04.309894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 107/222] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:04.311184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.318253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47463e-3d76-454a-87ce-412f4d2516b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.329995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:04.355086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:04.360430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.361939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.362220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.362486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.365763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:04.368168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:04.377999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 116/223] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:04.379265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.439643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110f48c-65e6-435a-840b-8da0767e9c20 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.484851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.485874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.486356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.486828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.501178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:04.507192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:04.508136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:04.509322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:04.516360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308374-c6c0-4fea-aba5-b611e502a236 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.516960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 108/224] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:04.518845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.560199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.561203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.561481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.561749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.574967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:04.581249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:04.583012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:04.583916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 117/225] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:04.584569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.630128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:04.663921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:04.664687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1d61-fd46-4f0a-91f9-256994016133 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.713879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.714489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.714770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.715047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.716148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=bef3105cb8a54d098376053c392d38d6) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:04.716463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:04.717981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:04.718971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec090-dcfa-42b1-975a-7e506ac0bacd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.724997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 109/226] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/role_assignments?user.id=bef3105cb8a54d098376053c392d38d6&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=f51ffc831d584368858aa77465ba49ed => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:04.725830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.804042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.805361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.806647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.807363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.809089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:04.811043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:04.812956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:04.838639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 118/227] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:04.848925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:04.934181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c893af-2fc5-4386-8650-99ed5d0f7430 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.977457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:04.977995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:04.978410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:04.978889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:04.980047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:04.980359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:04.981933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:04.995282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cda5d-cea7-47dd-b524-58936b11f966 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:04.995792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 110/228] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:05.000952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:05.006780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:05.029045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:05.047881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.048925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.049482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.049948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.051959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.053753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.055945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 119/229] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:05.062570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:05.126813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bda55-ca83-4188-8e07-ed44440889da None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:05.166899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.167559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.167845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.168121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.177734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.179432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.181633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 111/230] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:04 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:05.187378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:05.208092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa423-7dd4-4117-8925-6c752bee436e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:05.250009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.251065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.251598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.252205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.254228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.255986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.258437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 120/231] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:05 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:05.264136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:05.322241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:05.329493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:05.373882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755937b-a140-401b-b224-b1be4d8cfd5b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:05.379527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a6c84-444c-4d41-a286-47ea62852157 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:05.418175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.419255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.419735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.420230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/39db2ce3f4e74f70a97534d0bd9ff068/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.422846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, user_id=39db2ce3f4e74f70a97534d0bd9ff068, role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.424825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b6f21-793f-45f9-83f5-755ed4f61f84 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.434091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.435199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.435532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.435815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.438344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.441843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.446026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 112/232] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:05 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:05.448481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 121/233] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:05 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/39db2ce3f4e74f70a97534d0bd9ff068/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:05.454699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:05.570371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba951-8186-443a-98f2-df5e151aff38 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:05.607952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:05.608666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.608953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.609227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/39db2ce3f4e74f70a97534d0bd9ff068/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.611286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, user_id=39db2ce3f4e74f70a97534d0bd9ff068, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:05.613362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39141-5404-4cfb-be8b-a012a83c882b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:05.622596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:05.628775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 113/234] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:05 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/39db2ce3f4e74f70a97534d0bd9ff068/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:05.926085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d34-a741-498c-a07c-6b1d0a5c86c4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.926422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d34-a741-498c-a07c-6b1d0a5c86c4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.926596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32660d34-a741-498c-a07c-6b1d0a5c86c4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.927932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 122/235] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:05.937386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:05.937672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:05.937944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:05.966004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:05.967221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:06.058735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 114/236] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:06.094772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32660d34-a741-498c-a07c-6b1d0a5c86c4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.234465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32660d34-a741-498c-a07c-6b1d0a5c86c4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:06.253105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:06.275887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:06.276543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.276892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.277163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.292037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4c409945-91dc-41b5-ba77-85385194301c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:06.297666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:06.298535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:06.299330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:06.301784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 123/237] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:06.307519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.320268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9781-d0e5-49b6-9660-76c1cb5c5d2c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.322175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9781-d0e5-49b6-9660-76c1cb5c5d2c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.322457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9781-d0e5-49b6-9660-76c1cb5c5d2c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.323846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 124/238] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:06.329416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.329694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.329962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.353290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:06.354511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:06.489271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2589b7-45f4-43be-b1ea-90df93c3d6f4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:06.499417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 125/239] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:06.524161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:06.524829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.525113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.525390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.526115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:06.526424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:06.526898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:06.534223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:06.535368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.547409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 115/240] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:06.553071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.663842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b42a-f1fd-402d-a377-334ca389ee01 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:06.708296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:06.708975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.709252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.709522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] PATH_INFO: `/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.723470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0a2ee1deca43b0ada98ba102bba1ce)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:06.724957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:06.726966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 116/241] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:06 2022] GET /identity/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:06.732071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.746530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d9a8-5d59-4c82-9d80-70fd28d21ffd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:06.768988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:06.811086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:06.812137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:06.812617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:06.813114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:06.814790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:06.817232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:06.819335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 126/242] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:06.824946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:06.834515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:06.939858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c963b5b-749a-4ce8-b910-c3a4100c5b6d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:06.948468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b83824-5c84-441b-b62f-61afc1c763e5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.012174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.013993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.015305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.016290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.017731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.020189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867bc1f-dac6-46bb-b18a-ddca2555c892 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.023995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.024906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.025386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.025881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.061752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 127/243] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:06 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:07.156275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.158178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.217022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:07.244176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98388770-6f09-4009-8a72-d37bcad42dcd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.245166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98388770-6f09-4009-8a72-d37bcad42dcd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.245659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98388770-6f09-4009-8a72-d37bcad42dcd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.248822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 128/244] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:07.257071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.257655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.258443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.283628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:07.285749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:07.287757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 117/245] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:07.294225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:07.320204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:07.380700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 129/246] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:07.404185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:07.409097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ed41c-4205-4a43-912f-f2c0260179b3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.451556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.452587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.453205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.453684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.454953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.457195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.459778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 118/247] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:07.466009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:07.487132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:07.547212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41aedc-a39e-4328-ae21-86b9e2b55f12 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.588884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.589861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.590282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.590693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.592040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e180-4117-42fc-b37f-899647b91942 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.602135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:07.607372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:07.608436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:07.609432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:07.611609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 130/248] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:07.617387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:07.629873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.630512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.630843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.631122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.631919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=0a0a2ee1deca43b0ada98ba102bba1ce) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:07.632393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.634038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.640829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 119/249] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/role_assignments?user.id=0a0a2ee1deca43b0ada98ba102bba1ce&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=9b408d867b4f460cad1fde6a4626251f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:07.649472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:07.751173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e45e08-d63a-42b2-b534-c802e8feb50c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.798882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.799430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.799706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.799981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.800810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:07.801157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.802576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.813057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 131/250] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:07.819371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:07.916593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:07.938171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8b5c-cd4a-4da3-9d93-48d67f923b77 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:07.973559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:07.974220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:07.974500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:07.974774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] PATH_INFO: `/v3/users/bef3105cb8a54d098376053c392d38d6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:07.975946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] RBAC: Authorizing `identity:get_user(user_id=bef3105cb8a54d098376053c392d38d6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:07.977491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:07.979551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 120/251] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/users/bef3105cb8a54d098376053c392d38d6 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:07.984874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.120336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ca045-e242-4130-8ae6-4bb5a1382c23 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:08.129263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:08.157267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:08.158375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.158855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.159320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.160782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:08.162447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5bc07-fd2e-4e62-9e57-9865ecf8e93f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:08.164330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 132/252] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:07 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:08.172141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.172699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9548-5262-4e6c-bec8-3b24559a6519 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.173014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9548-5262-4e6c-bec8-3b24559a6519 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.173291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9548-5262-4e6c-bec8-3b24559a6519 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.174738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 133/253] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:08.186131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.186381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.186610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.222105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:08.223703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:08.325673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f4398-d3bd-4c27-ba43-1459c6a7ccdc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:08.353079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 134/254] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:08.365815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:08.366807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.367287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.367758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/bef3105cb8a54d098376053c392d38d6/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.369920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, user_id=bef3105cb8a54d098376053c392d38d6, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:08.371571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733509-b923-4560-aa44-34fd0bd3b307 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:08.385922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 121/255] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:08 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/bef3105cb8a54d098376053c392d38d6/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:08.392743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.417858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810210e-fd21-48c1-af21-59f4dac79472 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.418835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810210e-fd21-48c1-af21-59f4dac79472 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.419386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810210e-fd21-48c1-af21-59f4dac79472 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.422341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 122/256] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:08.427121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.427786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.428290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.458359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:08.459985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:08.464961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:08.602022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 123/257] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:08.614841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:08.648021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eb0c2-801d-45db-a77a-edef461c3caf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:08.662585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.709365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:08.710026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.710306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.710574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.739862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:08.744936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:08.745812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:08.746604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 135/258] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:08.754095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.782205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eefd21-f1c9-40bb-9991-325cbd09f138 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:08.821589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:08.822246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:08.822526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:08.822804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:08.835169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:08.840421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:08.841306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:08.842089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:08.842674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 124/259] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:08.843539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:08.849818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:08.998818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c90b-c276-43be-8609-c8e7daccacc5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.047484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.048685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.049318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.049912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.051369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:09.051853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.053598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.063089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 136/260] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:09.069866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:09.080167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:09.095703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac003c-7e1f-4f2d-a4ad-d540708cd113 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.169946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.170589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.170866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.171135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.171867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:09.172359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.173815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.195356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 125/261] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:09.201008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:09.268502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9204c9-b769-4475-9ff3-3d5f54143806 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.338715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.339360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.339746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.340017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.345483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.346992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.348710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 137/262] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:09 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:09.354076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:09.355471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:09.450943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba2276-a759-4cd8-ae40-79382d6a8fab None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.502634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.503888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.504165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.504429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] PATH_INFO: `/v3/users/39db2ce3f4e74f70a97534d0bd9ff068` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.505737 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] RBAC: Authorizing `identity:get_user(user_id=39db2ce3f4e74f70a97534d0bd9ff068)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.507330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.509254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 126/263] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:09 2022] GET /identity/v3/users/39db2ce3f4e74f70a97534d0bd9ff068 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:09.514661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:09.546586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:09.617804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afc3f7-6379-43a3-840a-7b197808eec4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.699538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73fbd-0e56-4013-abbd-b148d86ea58c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:09.709372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.710018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.710298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.710575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.772729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:09.794413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:09.795051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:09.795323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:09.795591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:09.857163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.859003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.938889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:09.974426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 138/264] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:58:09.978960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:09.978960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:09.980357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.140695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68501ef0-0520-4a33-bdeb-947c9279c758 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:10.167475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 127/265] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:10.179441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.198231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:10.199365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.199698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.199973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.205806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:10.208094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:10.211179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 139/266] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:09 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:10.217214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.235359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:10.300255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:10.382642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357419-9d25-4d6e-be51-c905cb9303dc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:10.393149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b97a-66d9-442c-abae-118f42171a10 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:10.426204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:10.426822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.427100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.427370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.428162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=39db2ce3f4e74f70a97534d0bd9ff068) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:10.428467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:10.429936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde123b9-6e3e-4d9a-a4e2-7432ef7b7715 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:10.446098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 140/267] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/role_assignments?user.id=39db2ce3f4e74f70a97534d0bd9ff068&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:10.447366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031eb03-ab09-4f51-a180-cbcd13f7c019 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.447653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031eb03-ab09-4f51-a180-cbcd13f7c019 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.447924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031eb03-ab09-4f51-a180-cbcd13f7c019 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.449189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 141/268] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:10.457165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be1ea9-81cb-41c8-8218-e71b519ea584 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.457483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be1ea9-81cb-41c8-8218-e71b519ea584 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.457961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be1ea9-81cb-41c8-8218-e71b519ea584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.475665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:10.476312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.476591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.476888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.479605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:10.481216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:10.482982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 128/269] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:10.490842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.504532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d4be1ea9-81cb-41c8-8218-e71b519ea584 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:10.505788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d4be1ea9-81cb-41c8-8218-e71b519ea584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:10.586208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 142/270] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:10.587843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b464d5-06de-4690-8e7b-745f03d8d8d8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.588414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b464d5-06de-4690-8e7b-745f03d8d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.589001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b464d5-06de-4690-8e7b-745f03d8d8d8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.590516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 143/271] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:10.598672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4a25-acf6-4c0f-bd30-7448e0aad880 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.599221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4a25-acf6-4c0f-bd30-7448e0aad880 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.599731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4a25-acf6-4c0f-bd30-7448e0aad880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.617603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:10.635171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-27ab4a25-acf6-4c0f-bd30-7448e0aad880 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:10.635616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd8b4a-7bfa-4ccd-bf78-07b0db0467b9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:10.637457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-27ab4a25-acf6-4c0f-bd30-7448e0aad880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:10.693134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:10.709916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:10.710560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.710839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.711111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.711910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=39db2ce3f4e74f70a97534d0bd9ff068) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:10.712232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:10.713714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:10.725690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 129/272] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/role_assignments?user.id=39db2ce3f4e74f70a97534d0bd9ff068&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:10.726736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.731346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 144/273] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:10.737665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f086-42a3-4588-ae44-0902f8ccce39 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.738859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f086-42a3-4588-ae44-0902f8ccce39 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.739345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f086-42a3-4588-ae44-0902f8ccce39 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.746419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 145/274] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:10.750859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.751143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.751410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.778392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:10.779938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:10.869192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 146/275] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:10.870817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.876989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341d24e-5ab1-4e9b-9565-cbcc8e3c10be None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:10.959096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:10.960096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:10.960577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:10.961150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:10.962435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:10.964095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:10.965950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 130/276] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:10.966901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:10.987778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:10.995667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d8395-f849-4864-8435-f9f6ba76b475 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.001741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.038335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.039244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.039664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.040095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.050746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:11.055891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:11.056961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:11.057996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:11.059999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 147/277] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:11.060982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.103955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828692d1-57cd-4b0b-99c9-d35ed605109e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.141134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.141785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.142069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.142339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.154053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:11.160212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:11.161379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 131/278] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:11.167061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.192060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655877-450d-4a34-b9bf-8ea815381cf8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.229719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.230260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.230541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.230815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.231498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.232961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.255885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 148/279] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:11 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:11.256711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.260777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.273743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.288219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712912-6d36-4848-8407-8ab81f7eb3c4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.339368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.340561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.341120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.341553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.342779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:11.343789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.346034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.359059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 132/280] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:11.372565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.411244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b9f1-4e24-4fed-9d5b-b6a426f1f648 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.458599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.461169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.461443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.461696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.462525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:11.462931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.464296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.474668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 149/281] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:11.479929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.514614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4877be-cb6e-4d1b-a00f-662c1b667f2a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.559678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.560058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.560337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.560740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] PATH_INFO: `/v3/users/4a5948587a7d4d1a9d52483225c94131` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.569983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.577208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] RBAC: Authorizing `identity:get_user(user_id=4a5948587a7d4d1a9d52483225c94131)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.578699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.580412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 133/282] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/users/4a5948587a7d4d1a9d52483225c94131 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:11.587091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.599002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.614591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e03c4-b666-4f7c-ada1-f225025987a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.676134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.677125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.677614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.678060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] PATH_INFO: `/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.679958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0a2ee1deca43b0ada98ba102bba1ce)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.682087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cad540-1bf2-4358-8d8c-2e407b972334 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.684962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 150/283] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:11.687079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b66-f040-48f4-8a31-a281368a8042 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.687548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b66-f040-48f4-8a31-a281368a8042 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.688350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6b66-f040-48f4-8a31-a281368a8042 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.691475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 151/284] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:11.692406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6b66-f040-48f4-8a31-a281368a8042 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.711877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2caff-014c-4aef-8680-7f7997de7426 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.749495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.749885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.750386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.750968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.752448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, user.id=4a5948587a7d4d1a9d52483225c94131, scope.system=all) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:11.752691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.755004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc8e41-9133-4dc8-8d98-8707c842f3e9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.760958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 134/285] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/role_assignments?user.id=4a5948587a7d4d1a9d52483225c94131&scope.system=all&role.id=f51ffc831d584368858aa77465ba49ed => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:11.762302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.762646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.763031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.782628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:11.783949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:11.834244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6b66-f040-48f4-8a31-a281368a8042 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:11.861740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 135/286] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:11.880907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:11.882152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:11.882615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:11.883066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:11.885248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:11.887389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:11.888055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.889575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 152/287] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:11.890405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:11.901738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:11.918503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:12.023699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec7c9-793b-4136-9828-dd60ea3a35ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:12.060446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f5fd2-2b2c-41f9-bd18-7a8855c759ee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:12.062660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:12.063579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:12.063852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:12.064123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/0a0a2ee1deca43b0ada98ba102bba1ce/roles/9b408d867b4f460cad1fde6a4626251f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:12.066689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, user_id=0a0a2ee1deca43b0ada98ba102bba1ce, role_id=9b408d867b4f460cad1fde6a4626251f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:12.068129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:12.090216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 153/288] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:11 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/users/0a0a2ee1deca43b0ada98ba102bba1ce/roles/9b408d867b4f460cad1fde6a4626251f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:12.112409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:12.113742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:12.115479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:12.115479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:12.126017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:12.131411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:12.132387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:12.133216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 136/289] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:12.143604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:12.220579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:12.259013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceafcc-ac6e-4727-8993-0a8c65f8348d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:12.296430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:12.297014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:12.297288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:12.297557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:12.298275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:12.298639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:12.300626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:12.309743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 154/290] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:12.315632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:12.382327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:12.422853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea49e3-5d66-4a95-90e4-6130241975e6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:12.459264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:12.459914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:12.460191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:12.460463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] PATH_INFO: `/v3/users/bef3105cb8a54d098376053c392d38d6` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:12.461663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] RBAC: Authorizing `identity:get_user(user_id=bef3105cb8a54d098376053c392d38d6)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:12.463114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:12.464738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 137/291] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:12 2022] GET /identity/v3/users/bef3105cb8a54d098376053c392d38d6 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:12.471048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:12.593926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae8582-e73b-4286-b07f-e833edadd29a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:12.623411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:12.633315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:12.634067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:12.634349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:12.634617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:12.732058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:12.733556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:12.872790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 155/292] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:12.878743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:13.023883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1a1fa-8f48-48df-a758-ffc34c3bc61a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:13.065356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:13.075195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:13.075856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:13.076181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:13.076454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:13.077687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:13.079229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605de9-9bf5-4619-a11e-e8f472e54ce8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:13.086551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 138/293] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:12 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:13.092881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:13.158518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:13.247179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7622693-384c-404b-9f1e-7ba54df2de6e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:13.299659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:13.300846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:13.301127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:13.301400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:13.302190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=bef3105cb8a54d098376053c392d38d6) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:13.302501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:13.303926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e6be-f660-4626-aa1d-a09afbec5ebf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:13.310318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 156/294] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:13 2022] GET /identity/v3/role_assignments?user.id=bef3105cb8a54d098376053c392d38d6&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=f51ffc831d584368858aa77465ba49ed => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:13.665454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf492-c454-4fcd-a11d-49433cafdbfa None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:13.665889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf492-c454-4fcd-a11d-49433cafdbfa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:13.665990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf492-c454-4fcd-a11d-49433cafdbfa None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:13.667961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 139/295] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:13.673402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:13.673870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:13.673947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:13.692571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:13.693793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:13.764168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 157/296] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:13.790020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbf492-c454-4fcd-a11d-49433cafdbfa None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:13.912365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbf492-c454-4fcd-a11d-49433cafdbfa None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:13.955927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:13.957079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:13.957409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:13.957940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:13.968550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d57dc11f-8aa7-4df7-84c8-e87bfc785fa6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:13.974468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:13.975349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:13.976134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 140/297] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:13.981823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.006523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.070063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf288c-1478-480f-9bb0-f072f771c6b5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.070683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf288c-1478-480f-9bb0-f072f771c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.071153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf288c-1478-480f-9bb0-f072f771c6b5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.072779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 141/298] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:14.077837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.078190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.078536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.089993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe70e90-6922-4ac3-936f-1aa8dec71baf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.108532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:14.110096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:14.130541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.131166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.131444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.131715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.132434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:14.132767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:14.134687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:14.146865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 158/299] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:14.153547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.175479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.194763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 142/300] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:14.226403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.269182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.286818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51eaad-6421-492f-90c2-3878af945da3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.325273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.326049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.326432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.327113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] PATH_INFO: `/v3/users/636e0c87b4d149438db819e4c5232c94` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.347793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] RBAC: Authorizing `identity:get_user(user_id=636e0c87b4d149438db819e4c5232c94)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:14.350168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:14.357870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 159/301] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/users/636e0c87b4d149438db819e4c5232c94 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:14.358612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.364408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ec56b-60d0-4c0c-ba28-bfaa9d79a0f3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.402027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.402707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.402990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.403309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.404485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:14.405996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:14.412571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 143/302] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:14.413583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.481750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.488225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62debb-3381-42c2-ab98-2b12ae5b93a5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.537978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.538594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.538875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.539144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.539929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, user.id=636e0c87b4d149438db819e4c5232c94, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:14.540094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e161c-d9cc-402b-a984-bf65de04fd6a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.540231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:14.541793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c87afc-eaa7-4112-8273-acc8c439c864 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:14.547128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 160/303] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/role_assignments?user.id=636e0c87b4d149438db819e4c5232c94&scope.system=all&role.id=9b408d867b4f460cad1fde6a4626251f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:14.548335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa46cd-2ff6-451b-a276-c5e13e03fa71 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.548615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa46cd-2ff6-451b-a276-c5e13e03fa71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.549239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa46cd-2ff6-451b-a276-c5e13e03fa71 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.550348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 161/304] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:14.558182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fec0-939b-435b-b848-f58070008824 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.558462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fec0-939b-435b-b848-f58070008824 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.558731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fec0-939b-435b-b848-f58070008824 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.560123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 162/305] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:14.561855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033ae0-d118-4168-825e-50344c16c506 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.561855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033ae0-d118-4168-825e-50344c16c506 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.562042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033ae0-d118-4168-825e-50344c16c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.583476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-94033ae0-d118-4168-825e-50344c16c506 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:14.583713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.584282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.584563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.584758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94033ae0-d118-4168-825e-50344c16c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:14.584906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] PATH_INFO: `/v3/groups` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.585597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:14.587203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.589111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a134d7-c429-4ee0-8940-bdc1cbd95586 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:14.609520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 144/306] 10.222.0.66 () {60 vars in 1134 bytes} [Thu Jul 28 05:58:14 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:14.611528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.611821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.612095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.638472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:14.641078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:14.685282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 163/307] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:14.708998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033ae0-d118-4168-825e-50344c16c506 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.731453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 145/308] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:14.759719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.822521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.835715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033ae0-d118-4168-825e-50344c16c506 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.880661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.882275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.882703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.883111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.892264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf71e-7674-4cb1-a9ab-345ae51c08ee None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:14.895993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:14.900301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:14.907935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:14.908864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:14.909659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:14.911047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 164/309] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:14.915532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:14.938751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:14.939465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:14.939672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:14.939943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:14.951452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:14.956399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:14.957378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:14.959009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 146/310] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:14.963707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.043259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062be1d-6352-49b2-8a94-d8bb811d37c9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.087210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0520b1-d385-4139-9ad5-d248c66196fc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.088399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.089312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.089834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.090242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.091116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:15.091568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.093289 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.100832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:15.104955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 165/311] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:15.110395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.142724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.144001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.144443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.145201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.146367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:15.147033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.149200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.165404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 147/312] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:15.167000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.188991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:15.232233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545327c4-5490-4262-a004-9e6df9672db0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.277280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.278196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.278196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.278481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] PATH_INFO: `/v3/users/4a5948587a7d4d1a9d52483225c94131` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.279634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] RBAC: Authorizing `identity:get_user(user_id=4a5948587a7d4d1a9d52483225c94131)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.281095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.284678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b1fd2-d0c4-4fa1-8264-66f92620e5c7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.287405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 166/313] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:15 2022] GET /identity/v3/users/4a5948587a7d4d1a9d52483225c94131 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:15.288448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.322728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.323648 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.324097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.324558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] PATH_INFO: `/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.326085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0a2ee1deca43b0ada98ba102bba1ce)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.327669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.329808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 148/314] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:15 2022] GET /identity/v3/users/0a0a2ee1deca43b0ada98ba102bba1ce => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:15.337237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.374274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:15.400923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ada64-4acb-4abf-a81c-aeb4130e843b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.429064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:15.437836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.439725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.440211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.441272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] PATH_INFO: `/v3/system/users/4a5948587a7d4d1a9d52483225c94131/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.442981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4a5948587a7d4d1a9d52483225c94131, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.444542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.445015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d958f6-b5c2-4265-b579-5668dd0a0820 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.454380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 167/315] 10.222.0.66 () {58 vars in 1334 bytes} [Thu Jul 28 05:58:15 2022] PUT /identity/v3/system/users/4a5948587a7d4d1a9d52483225c94131/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:15.485420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.486417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.486917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.487364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.569436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.571299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.610774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:15.681297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 149/316] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:15.687227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.796927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f1080-c24d-4b6d-ae3f-46d6627e4c02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:15.846365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:15.847585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:15.847863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:15.848129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:15.849353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:15.850822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca490385-89e5-4312-928a-e3e01d0d1331 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:15.852912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 168/317] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:15 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:15.858729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:15.968845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5ef5e-b82f-42ad-9e40-25dcb0d89869 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:16.007187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:16.008181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.008705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.009178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.010155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e, user.id=0a0a2ee1deca43b0ada98ba102bba1ce) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:16.010659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:16.012350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d0f6a-cd2e-4b87-9761-6abd63f89313 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:16.015705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:16.021509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 150/318] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:15 2022] GET /identity/v3/role_assignments?user.id=0a0a2ee1deca43b0ada98ba102bba1ce&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=9b408d867b4f460cad1fde6a4626251f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:16.642170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe8a2-004d-4185-a777-48d298b38e1e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.642555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe8a2-004d-4185-a777-48d298b38e1e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.642728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe8a2-004d-4185-a777-48d298b38e1e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.644715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 169/319] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:16.650198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3b15-175e-4e9c-ae81-e465c3d1db6a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.650491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3b15-175e-4e9c-ae81-e465c3d1db6a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.650767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a3b15-175e-4e9c-ae81-e465c3d1db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.669618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-268a3b15-175e-4e9c-ae81-e465c3d1db6a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:16.670809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-268a3b15-175e-4e9c-ae81-e465c3d1db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:16.740708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 151/320] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:16.762057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe8a2-004d-4185-a777-48d298b38e1e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:16.764673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b0bb-920a-433f-8381-bb5afdb6901b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.765209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b0bb-920a-433f-8381-bb5afdb6901b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.765482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b0bb-920a-433f-8381-bb5afdb6901b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.767882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 152/321] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:16.772759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.773045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.773315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.791216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:16.792371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:16.825146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:16.870106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 153/322] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:16.871321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe8a2-004d-4185-a777-48d298b38e1e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:16.892968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:16.904940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:16.905577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:16.905856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:16.906124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:16.918384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:16.923740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:16.924610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:16.926004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 170/323] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:16.931915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:16.954866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:17.001137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6be0-992b-40dc-b108-f81ffc62cd40 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.037861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.038570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.038851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.039128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.040284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:17.041785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:17.041883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575406c-57d5-4f32-b2a7-96c41a452a35 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.043650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 154/324] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:17.048976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:17.064303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:17.079407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.080035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.080302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.080583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.081869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:17.082177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:17.083817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:17.092607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 171/325] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:17.099083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:17.165674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81512b-6aec-4e37-bef5-36fff0fba733 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.196592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:17.205652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.206868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.207099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.207366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] PATH_INFO: `/v3/groups` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.208500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:17.209747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:17.218828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4e88-1632-4c52-b331-d38e1f407229 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.226719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 155/326] 10.222.0.66 () {60 vars in 1134 bytes} [Thu Jul 28 05:58:17 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:58:17.259903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.260655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.260969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.261437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] PATH_INFO: `/v3/users/636e0c87b4d149438db819e4c5232c94` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.263326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] RBAC: Authorizing `identity:get_user(user_id=636e0c87b4d149438db819e4c5232c94)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:17.264868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaf600-0d1f-47de-828b-af54cfd1d2e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:17.266813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 172/327] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:17 2022] GET /identity/v3/users/636e0c87b4d149438db819e4c5232c94 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:17.273133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:17.391249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686de69-d911-463f-9ae2-4134e99081ad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.428203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.428850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.429129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.429405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] PATH_INFO: `/v3/system/users/636e0c87b4d149438db819e4c5232c94/roles/9b408d867b4f460cad1fde6a4626251f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.430851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=636e0c87b4d149438db819e4c5232c94, role_id=9b408d867b4f460cad1fde6a4626251f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:17.432231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331956d-2a58-4ff2-9288-cb54fa1dc0f6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:17.442513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 156/328] 10.222.0.66 () {58 vars in 1334 bytes} [Thu Jul 28 05:58:17 2022] PUT /identity/v3/system/users/636e0c87b4d149438db819e4c5232c94/roles/9b408d867b4f460cad1fde6a4626251f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:17.552056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73a0ad-1a43-4034-9474-6b2d156c2771 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.552490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73a0ad-1a43-4034-9474-6b2d156c2771 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.552590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73a0ad-1a43-4034-9474-6b2d156c2771 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.554310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 173/329] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:17.560486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.561123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.561652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.584373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:17.585642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:17.638013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:17.662754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 157/330] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:17.684927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73a0ad-1a43-4034-9474-6b2d156c2771 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:17.769834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:17.830101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73a0ad-1a43-4034-9474-6b2d156c2771 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:17.869094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:17.869737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:17.870015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:17.870283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:17.884406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:17.889545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:17.890410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:17.891194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 174/331] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:17.896800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:18.021399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd697f-f0ad-43fd-a65f-40b7e308ce88 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:18.068855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:18.069497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:18.069777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:18.070049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:18.070770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:18.071079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:18.072466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:18.084420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 158/332] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:18.088343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:18.203325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578b661-d62c-4f48-abf7-9b086dc406fe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:18.214715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:18.242337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:18.242988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:18.243271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:18.243549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] PATH_INFO: `/v3/users/4a5948587a7d4d1a9d52483225c94131` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:18.244804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] RBAC: Authorizing `identity:get_user(user_id=4a5948587a7d4d1a9d52483225c94131)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:18.246253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbba53-2122-473e-afd5-d09f30f14284 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:18.252703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 175/333] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:18 2022] GET /identity/v3/users/4a5948587a7d4d1a9d52483225c94131 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:18.256757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:18.326820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:18.387818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50afec-48bb-4dd1-b011-4121b2aeb9cc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:18.434686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:18.435323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:18.435605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:18.435879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:18.441122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] RBAC: Adding query filter params (role.id=f51ffc831d584368858aa77465ba49ed, user.id=4a5948587a7d4d1a9d52483225c94131, scope.system=all) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:18.441122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:18.441122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f80512-e021-4b24-9f19-988290695628 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:18.451869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 159/334] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jul 28 05:58:18 2022] GET /identity/v3/role_assignments?user.id=4a5948587a7d4d1a9d52483225c94131&scope.system=all&role.id=f51ffc831d584368858aa77465ba49ed => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:19.743786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfc65-8ce1-4f01-82ec-1a89cb2f9b84 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:19.744929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfc65-8ce1-4f01-82ec-1a89cb2f9b84 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:19.745432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccfc65-8ce1-4f01-82ec-1a89cb2f9b84 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:19.747011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 176/335] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:19.753428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:19.753870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:19.754074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:19.781808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:19.783544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:19.786124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a1d0-066f-4eb4-9031-4150ed383945 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:19.786669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a1d0-066f-4eb4-9031-4150ed383945 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:19.787178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a1d0-066f-4eb4-9031-4150ed383945 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:19.789052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 177/336] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:19.794800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:19.795363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:19.795847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:19.816183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:19.818463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:19.884761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 160/337] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:19.900739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 178/338] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:19.920126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:19.926961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:19.993003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.130444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a37d-0c88-46ee-855d-4cd457923e62 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.143779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d025f45-a5ad-426d-8405-8cd318eff209 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.162125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.167830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.168799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.169226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.169656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.182408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:20.188023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:20.189158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:20.190160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:20.194836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 161/339] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:20.200220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.214197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.214867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.215414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.215414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.241764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:20.247898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:20.249022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:58:20.250174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:20.254576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 179/340] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:20.261693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.316548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f06c7-0ef6-4824-a17d-f1d10fafbee9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.325000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.357356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.357911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.358186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.358463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.359189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:20.359495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:20.365565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:20.379152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 162/341] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:20.388672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.409950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31b15-6c16-4509-b084-dfa903215729 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.470786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.472221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.472668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.473093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.473965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:20.474408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:20.475933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:20.492801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 180/342] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:20.497609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.503662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69cf-62c4-4d5e-a43a-c3f03f6d9d1e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.541764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.542494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.542845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.543192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.548670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.576338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.624748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:20.624748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edd3f1-3d2c-49a5-a523-86e86795dc96 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:20.660592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc3c5-9792-4393-9c30-22d866afa5b0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.724909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.725566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.725844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.726115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] PATH_INFO: `/v3/users/636e0c87b4d149438db819e4c5232c94` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.727315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=636e0c87b4d149438db819e4c5232c94)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:20.728778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb9c78-666f-4c49-ab10-c1b37b03c7f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:20.730676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 181/343] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/users/636e0c87b4d149438db819e4c5232c94 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:20.731826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae654-a19b-49e1-8889-144d93a6b050 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.732103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae654-a19b-49e1-8889-144d93a6b050 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.732378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae654-a19b-49e1-8889-144d93a6b050 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.738414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 182/344] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:20.739629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7e91-7975-400a-89f3-969b77a522fb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.739942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7e91-7975-400a-89f3-969b77a522fb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.740180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e7e91-7975-400a-89f3-969b77a522fb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.741451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 183/345] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:20.742153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7e91-7975-400a-89f3-969b77a522fb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.746670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 163/346] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:20.748024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee4b5-aa60-4654-9d08-37367ffd386e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.748312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee4b5-aa60-4654-9d08-37367ffd386e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.748682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ee4b5-aa60-4654-9d08-37367ffd386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.770459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-081ee4b5-aa60-4654-9d08-37367ffd386e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:20.771651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-081ee4b5-aa60-4654-9d08-37367ffd386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:20.828277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.850032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 164/347] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:20.851532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.851822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.852098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.858456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:20.865740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e7e91-7975-400a-89f3-969b77a522fb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:20.873970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:20.875015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:20.903901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:20.904880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:20.905359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:20.905849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:20.906840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] RBAC: Adding query filter params (role.id=9b408d867b4f460cad1fde6a4626251f, user.id=636e0c87b4d149438db819e4c5232c94, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:20.907375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:20.909057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:20.922882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 184/348] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/role_assignments?user.id=636e0c87b4d149438db819e4c5232c94&scope.system=all&role.id=9b408d867b4f460cad1fde6a4626251f => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:20.930097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:20.957011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 165/349] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:20.958266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.072799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9226e1b-e3be-4591-9d5e-ee6a8911ac6d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.109066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.120753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ca723-a563-4628-a30e-51e7af7d5b06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.121813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.122471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.122749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.123029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.139949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:21.149568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:21.150550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:21.151368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:21.156775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 166/350] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:21.157735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.165455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.166484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.166993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.167471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.169011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.170697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.173065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 185/351] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:20 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:21.174199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.219427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.287764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c91b0-0f09-437e-8379-f8cd6a609d5d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.328617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.329310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea4c4-20e7-4fd5-9e2d-2df670fda016 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.329834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.330335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.330917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.332000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:21.332510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.334371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.344257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 186/352] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:21.345422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.374150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.375074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.375495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.375976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.387326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:21.393311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:21.394258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:21.395036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:21.397396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 167/353] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:21.398600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.440220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.446407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.464344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af797f-82ba-40ad-b51e-f6e9eff6fc58 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.505585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.506240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.506518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.506789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.513831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.515333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.516003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c097ee-ef4c-41e9-8530-b840537723b5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.520662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 187/354] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:21.520662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.575447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.576447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.576976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.577457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.646641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c610126-8588-4d59-aea6-03d79d56de4a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.651244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.652992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.683509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.684137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.684417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.684787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.685430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:21.685735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.687334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.692807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.699663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 188/355] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:21.700439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.716055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.767157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 168/356] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:21.768590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.809999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1862d-d88d-4942-8c4e-415d1dc16071 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.847667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.848287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.848576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.848873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.849664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:21.849976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:21.851403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:21.860536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 189/357] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=f51ffc831d584368858aa77465ba49ed => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:21.860536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:21.890984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4602-1002-48a9-bf9e-f1eae6c55302 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:21.933538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:21.934097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:21.934371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:21.934642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:21.937911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.952608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:21.986651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b153a09-d131-4216-b944-aa5d66f106ae None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.026970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.027636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.027915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.028186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.029520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.031241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29200b05-8a57-466c-8d5b-2ef091d609b4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.033626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 190/358] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.035536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e38a-023b-4ebf-ad64-f1a4e741ca79 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.035818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e38a-023b-4ebf-ad64-f1a4e741ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.036088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e38a-023b-4ebf-ad64-f1a4e741ca79 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.037659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 191/359] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:22.041889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.043455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.045005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.045284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.045639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.067036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:22.068226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:22.152674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 192/360] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:22.153606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.176422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 169/361] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:22.185911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.227408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.246385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.276531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce08d37-d236-4647-af8b-4eb51a80ebd5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.316852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.317886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.318418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.320795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad8dd4-3dae-4fa3-bba8-7e9cd6dde26d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.321318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.322960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.324672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.326529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 193/362] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.327548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.359252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.360334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.360851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.361338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.362860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.364587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.366958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 170/363] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.368019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.455008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f937b-be39-4643-a3be-956f543927ad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.489391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db84e54-9e56-4394-b584-87bf8eaabd14 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.491060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.506018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.507069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.508252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.508789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.520873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:22.526736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:22.527636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:22.528438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 194/364] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:22.529872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.531901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.532707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.536882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283d174-e87a-4284-837a-178f00d983f0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.548973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 171/365] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.550095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a9c1-bbc0-499e-81c4-226a030a1de8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.550414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a9c1-bbc0-499e-81c4-226a030a1de8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.550714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a9c1-bbc0-499e-81c4-226a030a1de8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.556190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 172/366] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:22.557182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a9c1-bbc0-499e-81c4-226a030a1de8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.725917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3583d0-78e3-4329-914f-bb3c5c3eb19f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.759541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a9c1-bbc0-499e-81c4-226a030a1de8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:22.800193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.800888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.801146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.801413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.802562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.803996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7e2f9-5eba-4833-9a4a-58086c2c363c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.806985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 195/367] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.808164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f469-692a-4acb-b17b-916628628e07 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.808442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f469-692a-4acb-b17b-916628628e07 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.810487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453f469-692a-4acb-b17b-916628628e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.833871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6453f469-692a-4acb-b17b-916628628e07 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:22.834963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:22.835097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6453f469-692a-4acb-b17b-916628628e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:22.835600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:22.835882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:22.836151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:22.839847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:22.840171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:22.841591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:22.867788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 173/368] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:22.869196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:22.925385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.932608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:22.935759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 196/369] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:22.936440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453f469-692a-4acb-b17b-916628628e07 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.109620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9946dca-b483-4c57-857b-c74c2fc0b04a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.145536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453f469-692a-4acb-b17b-916628628e07 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.163747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.164766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.165219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.165695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.166785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:23.167381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:23.169013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:23.175751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 174/370] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=f51ffc831d584368858aa77465ba49ed => generated 260 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:23.177450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.212119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.212469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.212773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.213039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.285263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:23.295904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218f5e4-ad68-4784-93fa-beb5a9c6103e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.341031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.342148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.342604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.343070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.356259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:23.361824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:23.363329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:23.364118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:23.366672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 175/371] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:23.374049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.392193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:23.396857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:23.398710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:23.537124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b486d-2150-4cbe-9724-43ed15a43670 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.544432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 197/372] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:23.552666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.595436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.596067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.596339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.597251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.598090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:23.598388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:23.599775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:23.615469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 176/373] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:23.623206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.648271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:23.723282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:23.726345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6a562-6500-4569-b486-0890b32d163f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.789812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.790463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.790735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.790999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.792253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:23.793709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:23.795358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 198/374] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:23 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:23.801962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:23.811612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2dec-7a48-4c58-a387-64f928568447 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:23.888176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:23.888895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:23.889173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:23.889550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:23.999647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.002497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.054017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:24.057121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ce458-2940-42c7-942f-7fcdacdfe42a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.119284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.121198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.122818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.123247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.125457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.127274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.132923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 199/375] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:23 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:24.138401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.158381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 177/376] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:24.164975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.203058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:24.304838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea967-a86b-47bb-8759-6816fe1e3e3b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.327453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15be4-3c23-4c43-8dfb-92a41f92bc8c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.341150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.341991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.342509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.342977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.343955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:24.344463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.346097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc25b60-0904-408d-bd91-aec1ba2e96ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.347740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:24.360783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 200/377] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:24.362626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b427b5-fb30-4060-bbba-32d075d3c39a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.363142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b427b5-fb30-4060-bbba-32d075d3c39a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.363610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b427b5-fb30-4060-bbba-32d075d3c39a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.365492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 201/378] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:24.373260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.374158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.374578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.374989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] PATH_INFO: `/v3/projects/451944c8b2d04df49098731529a931c8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.376326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] RBAC: Authorizing `identity:get_project(project_id=451944c8b2d04df49098731529a931c8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.378543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.379184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.379465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.379732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.381415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 178/379] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/projects/451944c8b2d04df49098731529a931c8 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:24.387193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.411603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:24.417542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:24.517419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760cc6-9cf8-4c61-93ed-1cf208309582 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.523373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 202/380] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:24.556432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.557485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.557968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.558456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] PATH_INFO: `/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.560355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.566598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] RBAC: Authorizing `identity:get_group(group_id=7393ce164cfe4ef6b91acd9a3a8480a8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.570095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.570095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 179/381] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:24.576081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.613327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:24.634429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:24.703578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1738-0b4b-4d39-901c-047eac3cf495 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.734813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c916-3d12-4c30-9afa-1535f6497d4f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.742550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.743527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.744037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.744526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.745557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] RBAC: Adding query filter params (group.id=7393ce164cfe4ef6b91acd9a3a8480a8, role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=451944c8b2d04df49098731529a931c8) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:24.746068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:24.747840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:24.755133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 180/382] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/role_assignments?group.id=7393ce164cfe4ef6b91acd9a3a8480a8&scope.project.id=451944c8b2d04df49098731529a931c8&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:24.802833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:24.803489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:24.803765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:24.804032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:24.819308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:24.824573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:24.825547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:24.826337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:24.827418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 203/383] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:24.832172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:24.967860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6429f-4170-40ee-9810-b24a78789502 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:24.980725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:25.013345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:25.013974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.014255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.014593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.015332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:25.015635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:25.017117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd9ef-9de1-4c29-ab60-813abb18ddba None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:25.028475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 181/384] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:25.032542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:25.161604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:25.171279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d5c9-b74d-45ac-9079-dbb4c8c3e23d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:25.215571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9adaf0-650d-4cff-9c0a-b2ed1ff84f70 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.216265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9adaf0-650d-4cff-9c0a-b2ed1ff84f70 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.216869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9adaf0-650d-4cff-9c0a-b2ed1ff84f70 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.218622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:25.219075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 182/385] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:25.219243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.223888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.223888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.224306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:25.225687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.225808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:25.226292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.226768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.227742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 204/386] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:25 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:25.233226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:25.257849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:25.259387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:25.400417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583c6b-580a-4564-a260-a2d8c0dc6acf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:25.423299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 183/387] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:25.442387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:25.443294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.443761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.444175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.445674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:25.447316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:25.457623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 205/388] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:25 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:25.461105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:25.468724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:25.497255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:25.574860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38794b-8eee-4212-957b-0b14133e93a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:25.619578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:25.620505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.621078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.621482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/groups/f5bab80fdd19469aad3f94c0bd132683/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.625926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, group_id=f5bab80fdd19469aad3f94c0bd132683, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:25.627711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:25.657923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 206/389] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jul 28 05:58:25 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/groups/f5bab80fdd19469aad3f94c0bd132683/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:58:25.695600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a940-ab04-4b16-8864-8bacd48cf981 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:25.697475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:25.736194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:25.737251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.737672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.738078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.752180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-e4a35b3d-206e-43aa-b77a-6a06f0d49bef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:25.758364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:25.759496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:25.760538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:25.762765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 184/390] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:25.769265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:25.827985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950144-dfb6-4d11-aa95-8ace385d3761 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.828552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950144-dfb6-4d11-aa95-8ace385d3761 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.829074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950144-dfb6-4d11-aa95-8ace385d3761 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.831675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 185/391] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:25.839401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:25.839937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:25.840349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:25.868129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:25.871219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:25.924209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:25.954577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440271b1-b19b-4f11-91af-72310231f3ee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:25.994711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 186/392] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:26.017966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.018864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.018977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.019726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.020139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.021042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:26.021561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.023153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.039211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 207/393] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:26.050404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.132839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:26.143776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dde4c-5494-4b0f-9087-fb3902dc9804 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.198613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.199269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.199543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.199812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.221137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:26.226563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:26.227597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:26.228365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:26.236093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 187/394] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:26.237789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.286570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11551d-9154-4605-9b73-4ac61cb159bc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.349238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fafdf-dadf-490b-9398-c36d2bcdfc9c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.367247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.367991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.368179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.368616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.371172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.372826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.376014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 208/395] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:26.381134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.387997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.388947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.389443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.389934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.390989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] RBAC: Adding query filter params (name=member) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:26.391488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.393132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.402402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 188/396] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:26.410442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.420611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:26.431120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:26.522519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f841161-6c94-4953-b459-78e8cd485861 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.543035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a134269-1afa-4cf9-b0a4-adb7c334c40d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.565307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.566310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.566935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.568592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.570715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.575086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.576944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 189/397] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:26.585620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.593876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.594724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.595134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.595560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.597438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.599023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.601155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 209/398] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:26.607163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.698898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:26.711960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:26.718599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bf85b-b67d-4bd2-9fbd-fb67455ba165 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.741690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b9d29-07f1-44b3-8fcc-9b6c108c1d20 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.755353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.756036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.756490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.756968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/groups/f5bab80fdd19469aad3f94c0bd132683/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.759301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] RBAC: Authorizing `identity:create_grant(project_id=62b44cc2bb6d48219683bf7aa01ae141, group_id=f5bab80fdd19469aad3f94c0bd132683, role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.760899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.778523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 210/399] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jul 28 05:58:26 2022] PUT /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141/groups/f5bab80fdd19469aad3f94c0bd132683/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:58:26.815977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.816719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.817185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.817554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.821131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:26.822756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ef3ff-0b8b-4621-9ea4-13ab64ca793e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:26.824722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 190/400] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:26 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:26.831700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:26.954926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315558e2-1cb7-41ad-877b-7ee4a497f295 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:26.994651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:26.995683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:26.996154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:26.996621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/groups/f5bab80fdd19469aad3f94c0bd132683/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:26.998735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, group_id=f5bab80fdd19469aad3f94c0bd132683, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:27.000731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdc3c-c78e-43bb-aee9-3870ee017fdd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:27.019082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 211/401] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jul 28 05:58:26 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/groups/f5bab80fdd19469aad3f94c0bd132683/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:27.291170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464daa0-72e4-42d0-8f1a-a643ac353fdd None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.291674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464daa0-72e4-42d0-8f1a-a643ac353fdd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.291775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464daa0-72e4-42d0-8f1a-a643ac353fdd None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.293375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 191/402] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:27.298604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4529c-9c54-4317-b072-72553cb448b8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.299475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4529c-9c54-4317-b072-72553cb448b8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.299985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4529c-9c54-4317-b072-72553cb448b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.308312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:27.324201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1df4529c-9c54-4317-b072-72553cb448b8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:27.326420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1df4529c-9c54-4317-b072-72553cb448b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:27.410086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 212/403] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:27.444337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464daa0-72e4-42d0-8f1a-a643ac353fdd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:27.469120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362c74-d314-41a6-ade8-144d0249df39 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.469453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362c74-d314-41a6-ade8-144d0249df39 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.469674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362c74-d314-41a6-ade8-144d0249df39 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.471194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 213/404] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:27.486483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.486777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.487023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.517723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:27.518972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:27.586023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464daa0-72e4-42d0-8f1a-a643ac353fdd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:27.595443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 214/405] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:27.623937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:27.624893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.625414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.625906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.633640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:27.639311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:27.645110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:27.645984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:27.646768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:27.649176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 192/406] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:27.655233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:27.668599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:27.793946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:27.814526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ec09-f62d-4ff7-8c7d-a0e650e3aef7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:27.872666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be561dc-c94e-4d20-a35c-7f19df68740f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:27.885061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:27.886028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.886512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.887007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.887928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:27.888535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:27.891852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:27.905729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 193/407] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:27.912851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:27.951892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:27.952908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:27.953661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:27.954298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:27.978734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:27.984841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:27.985714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:27.986521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:27.992278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 215/408] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:27.997793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.069003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:28.104276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447d91-3071-4831-9de9-7923527ff7df None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.127092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81be2b-a93e-4724-95e2-fb61d2a3407f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.152071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:28.158273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.158928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.159747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.160017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.164292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.164946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.165225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.165324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.165489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.166207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:28.166512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.166801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.167864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.168794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 194/409] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:27 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:28.174149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.182602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 216/410] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:28.190377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.291603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221248a-6a61-4ceb-834a-4373a2f3adbd None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.316535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348e5f5-2910-4660-bfb0-f5ced3ae8ad8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.342270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.342934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.343209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.343489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.349384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.350850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.352927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 195/411] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:28 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:28.357994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.358652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.358933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.359211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] PATH_INFO: `/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.361019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] RBAC: Authorizing `identity:get_group(group_id=7393ce164cfe4ef6b91acd9a3a8480a8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.361487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.362482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.364350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 217/412] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:28 2022] GET /identity/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:28.369962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.375792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:28.429712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:28.479584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe838a-728a-4cd3-b2f9-8ea827c3c834 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.516572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.517605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.518127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.519089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] PATH_INFO: `/v3/projects/451944c8b2d04df49098731529a931c8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.520436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=451944c8b2d04df49098731529a931c8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.522223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.524409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 218/413] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:28 2022] GET /identity/v3/projects/451944c8b2d04df49098731529a931c8 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:28.530616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:28.536453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71707-6626-4852-9275-4e84608e52a3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.598345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.598956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.599237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.599512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/groups/f5bab80fdd19469aad3f94c0bd132683/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.606540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e81d4ed6ee47c188fbebdf70321d3e, group_id=f5bab80fdd19469aad3f94c0bd132683, role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.607933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5fc4c-f7f5-4f20-8f9a-9fca095fdc48 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.638456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416550-fef9-49aa-961a-449766295bc0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:28.639149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 196/414] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jul 28 05:58:28 2022] PUT /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e/groups/f5bab80fdd19469aad3f94c0bd132683/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:28.679417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:28.697441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:28.698120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.698407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.698682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] PATH_INFO: `/v3/projects/451944c8b2d04df49098731529a931c8/groups/7393ce164cfe4ef6b91acd9a3a8480a8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.700789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] RBAC: Authorizing `identity:create_grant(project_id=451944c8b2d04df49098731529a931c8, group_id=7393ce164cfe4ef6b91acd9a3a8480a8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:28.702228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26273d25-96a8-4f20-b9b6-8992399992fa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:28.735334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 219/415] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jul 28 05:58:28 2022] PUT /identity/v3/projects/451944c8b2d04df49098731529a931c8/groups/7393ce164cfe4ef6b91acd9a3a8480a8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:28.909573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d002c-bde6-484c-9c00-0fd569a1cc4c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.909906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d002c-bde6-484c-9c00-0fd569a1cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.910076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d002c-bde6-484c-9c00-0fd569a1cc4c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.911783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 197/416] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:28.917408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:28.917696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:28.917966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:28.945900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:28.947137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:29.024170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 220/417] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:29.047076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d002c-bde6-484c-9c00-0fd569a1cc4c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:29.142965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:29.199777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d002c-bde6-484c-9c00-0fd569a1cc4c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:29.248095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:29.248775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.249059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.249335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.266223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ae17e0c9-1366-44a3-ad57-1f0d906ee4ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:29.272180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:29.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:29.274321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 198/418] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:29.279423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:29.442545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1d00-4b4e-49fd-8e68-1c58fe174a5b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.443045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1d00-4b4e-49fd-8e68-1c58fe174a5b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.443155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf1d00-4b4e-49fd-8e68-1c58fe174a5b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.444782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 199/419] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:29.452168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.452395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.452690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.460625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23a29a-eb8d-4310-a589-ad5e92ea1792 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:29.477428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:29.478646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:29.494857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:29.541601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:29.542570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.542858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.543131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.544182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:29.544492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:29.546536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:29.570819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 221/420] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:29.576551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:29.592272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 200/421] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:29.626223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:29.697712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:29.724239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43200b-3f62-4c4d-bb48-bd1818f2b3fa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:29.749441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7890dcb-ce49-40eb-97bd-067c4a3e78ec None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:29.768185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:29.769365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.769652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.769920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.793289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:29.794544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.795019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.795482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.810462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-67e2438a-2348-4306-8487-b4166b1e329c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:29.817548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:29.818429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:29.819216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:29.822260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 201/422] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:29.824584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:29.827457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187fb0-fa26-401d-82c1-678a46adbe29 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.828237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187fb0-fa26-401d-82c1-678a46adbe29 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.828757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187fb0-fa26-401d-82c1-678a46adbe29 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.831098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 202/423] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:29.832022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187fb0-fa26-401d-82c1-678a46adbe29 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:29.855650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:29.857438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4d8af-e0ad-4d02-9fd0-c9a5a957afe4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:29.947259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187fb0-fa26-401d-82c1-678a46adbe29 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:29.959360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 222/424] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:29.960991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.961472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.961959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.972127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:29.985277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:29.987995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:29.992373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:29.993033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:29.993306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:29.993576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:29.994348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:29.994651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:29.996076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.007721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 203/425] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.008807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.091150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 223/426] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:30.097780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.101282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.162262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe64c6-169d-45ac-baf1-740af6901d44 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.201150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.202244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.202731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.203473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.205033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.206819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.209054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 204/427] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.211057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.227428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deceda2-bb1f-42af-b9d3-dff65b50faef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.267506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.276899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.277973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.278254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.278518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.340839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d1f6-87af-4c6d-bd16-381a80915b4a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.353131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.354804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.358480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.383838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.384938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.385511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.385996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.397530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:30.403420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:30.404283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:58:30.405162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:30.412832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 205/428] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:30.414008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.467496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 224/429] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:30.468585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.519222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea401-564e-4962-8bc0-840c3449d21f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.529136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.555495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.556438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.556966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.557438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.558907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.560682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.562596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 206/430] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.563668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.584334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422da4e-a845-451f-af75-c073f02962b4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.586907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.622297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.623020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.623367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.623696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.624467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:30.624928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.626452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.639891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 225/431] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.639891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.690954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca0ff5-bf61-42a6-b8d0-215faf612e8b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.729827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.730817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.731273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.731771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] PATH_INFO: `/v3/projects/62b44cc2bb6d48219683bf7aa01ae141` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.733331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=62b44cc2bb6d48219683bf7aa01ae141)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.735090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.737481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 207/432] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/projects/62b44cc2bb6d48219683bf7aa01ae141 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.738554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.748726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf321-0313-4ee1-a034-d2d6beb6eabb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.785391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.786107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.786795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.786795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.787650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:30.788024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.789652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:30.791760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.805087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 226/433] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=f51ffc831d584368858aa77465ba49ed => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:30.806525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:30.858851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:30.866039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97862b65-7951-46fe-acd4-9c4a9cb45bc2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.922358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.923414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.923892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.924387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.953198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709eee3-b767-4b28-ad2f-706621215c6b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:30.991759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:30.992397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:30.992696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:30.992968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:30.994284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:30.995639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.000704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 227/434] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.003849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.036478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.038277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa17b1-687d-4293-a9ea-511385e866f3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.107758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.165054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.169148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80d4c-4e35-4aa5-8c7d-2c7bcc726cef None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.190274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 208/435] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:31.191906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ec17-728f-40e5-a386-7f6410cb85a6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.192184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ec17-728f-40e5-a386-7f6410cb85a6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.192454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599ec17-728f-40e5-a386-7f6410cb85a6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.194040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 209/436] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:31.195104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441d23-cd7b-4504-8d12-368de7032ae9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.195381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441d23-cd7b-4504-8d12-368de7032ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.195651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441d23-cd7b-4504-8d12-368de7032ae9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.201490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 210/437] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:31.202517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441d23-cd7b-4504-8d12-368de7032ae9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.210300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.210928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.211208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.211481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.212271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=62b44cc2bb6d48219683bf7aa01ae141) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:31.212584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.214038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928653f-29a9-412e-8372-117f174e9cd2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.221981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 228/438] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=62b44cc2bb6d48219683bf7aa01ae141&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.223420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c353-b033-47e1-9c3f-7614c3ece32c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.223711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c353-b033-47e1-9c3f-7614c3ece32c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.223985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c353-b033-47e1-9c3f-7614c3ece32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.246462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5375c353-b033-47e1-9c3f-7614c3ece32c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:31.247725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5375c353-b033-47e1-9c3f-7614c3ece32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:31.344751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 229/439] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:31.344751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.344751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.344751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.360999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441d23-cd7b-4504-8d12-368de7032ae9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.370065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:31.371293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:31.413781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.415547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.415850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.416127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.417391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.418796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.421208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 211/440] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.421882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.438839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.454993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 230/441] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:31.455965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.482200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.550250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941f7d-899d-4c22-b1a5-c3560aad4c45 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.573185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87aaa8-26c2-4ab4-9262-bd2fdd4f76cb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.591656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.592297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.592572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.592882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.604302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:31.609332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:31.610213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:31.611232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 212/442] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:31.612777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.620362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.621311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.621793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.622282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.624256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.625722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.627472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 231/443] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.628138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.689296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.718175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.720628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42e6df-58ad-4cc4-983a-f3324cee3de7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.728334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d979c5-ff79-492c-9cef-92830aff12af None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.754840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.755473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.755745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.756010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.761681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.762286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.762567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.762836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.763542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:31.763845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.765233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.765955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:31.770979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:31.771909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:31.773017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 213/444] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:31.773865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.776837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 232/445] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.778088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.874567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e1de0-d326-43e8-9594-61b5a722ac8a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.876775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8c7c3-8f06-4103-b9a7-1dd20f744033 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:31.904529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:31.907263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.907873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.908155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.908429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.909685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:31.909996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.911359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.912023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:31.912626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:31.912924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:31.913191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:31.913963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=f51ffc831d584368858aa77465ba49ed, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:31.914266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:31.915670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:31.919229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 233/446] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:31.919229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.926974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 214/447] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=f51ffc831d584368858aa77465ba49ed => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:31.927791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:31.940391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.038397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7e81-efe4-49cb-9281-f384245f3e21 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.044325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf9658-4b8d-4253-997d-e210c4d311bb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.075610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.076251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.076531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.076835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.089898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.090528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.090815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.091092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.166490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.167697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.169817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.172088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.173068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.190602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.289601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 215/448] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:32.295729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.299738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 234/449] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:32.305417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.391118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.397801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2f11b-e389-4f26-a1f6-a216634390d8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.407354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ca5-28e5-4fff-a265-080e96c9d616 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.421660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.431159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.431788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.432060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.432333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] PATH_INFO: `/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.433494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] RBAC: Authorizing `identity:get_project(project_id=24e81d4ed6ee47c188fbebdf70321d3e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.434911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.436558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 216/450] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/projects/24e81d4ed6ee47c188fbebdf70321d3e => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:32.442503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.445983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.446626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.446903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.447176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] PATH_INFO: `/v3/projects/451944c8b2d04df49098731529a931c8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.448316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] RBAC: Authorizing `identity:get_project(project_id=451944c8b2d04df49098731529a931c8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.449777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.451419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 235/451] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/projects/451944c8b2d04df49098731529a931c8 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:32.457221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.540583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24105c-3a15-43e6-9f00-4a420179925f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.552542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5ff4a-30bd-470f-9e9c-9b4bba25be3e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.573862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.574487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.574767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.575034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] PATH_INFO: `/v3/groups/f5bab80fdd19469aad3f94c0bd132683` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.576155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] RBAC: Authorizing `identity:get_group(group_id=f5bab80fdd19469aad3f94c0bd132683)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.577611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.579359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 217/452] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/groups/f5bab80fdd19469aad3f94c0bd132683 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:32.585800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.591318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.591956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.592231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.592498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] PATH_INFO: `/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.593669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] RBAC: Authorizing `identity:get_group(group_id=7393ce164cfe4ef6b91acd9a3a8480a8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.595099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.596989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 236/453] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/groups/7393ce164cfe4ef6b91acd9a3a8480a8 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:32.602505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:32.619476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.652681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:32.687855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cefd9-0cdb-4d33-9d06-1e9ee99d38a1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.702627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573833-53f3-494d-8f5a-01a480dae058 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:32.724577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.725220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.725496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.725766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.726547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] RBAC: Adding query filter params (group.id=f5bab80fdd19469aad3f94c0bd132683, role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:32.726864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.728296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545ae30-f7c9-4030-9e2a-e8efb3bdaa88 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.734039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 218/454] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/role_assignments?group.id=f5bab80fdd19469aad3f94c0bd132683&scope.project.id=24e81d4ed6ee47c188fbebdf70321d3e&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:32.737797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:32.738419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:32.738693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:32.738957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:32.739748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] RBAC: Adding query filter params (group.id=7393ce164cfe4ef6b91acd9a3a8480a8, role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=451944c8b2d04df49098731529a931c8) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:32.740055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:32.741534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6537b-8b71-46a2-a6b4-f783c26e22fd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:32.748159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 237/455] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jul 28 05:58:32 2022] GET /identity/v3/role_assignments?group.id=7393ce164cfe4ef6b91acd9a3a8480a8&scope.project.id=451944c8b2d04df49098731529a931c8&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:35.229625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f2fa-5706-43c9-b182-fbca70e6449a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.230627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f2fa-5706-43c9-b182-fbca70e6449a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.231161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f2fa-5706-43c9-b182-fbca70e6449a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.233028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 219/456] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:35.238945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989030-67ab-497e-af75-92dc44ee1525 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.239428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989030-67ab-497e-af75-92dc44ee1525 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.239502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989030-67ab-497e-af75-92dc44ee1525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.263762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-31989030-67ab-497e-af75-92dc44ee1525 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:35.265073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-31989030-67ab-497e-af75-92dc44ee1525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:35.360495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 238/457] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:35.406189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31f2fa-5706-43c9-b182-fbca70e6449a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:35.535872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:35.541350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31f2fa-5706-43c9-b182-fbca70e6449a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:35.591645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:35.592302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.592578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.592882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.604007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:35.605496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:35.629177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:35.630237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:35.631298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:35.631298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:35.631298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:35.631298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:35.633254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 220/458] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:35.636666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f4db-446b-42c5-bd52-2151fc7a64c8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.637179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f4db-446b-42c5-bd52-2151fc7a64c8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.637632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f4db-446b-42c5-bd52-2151fc7a64c8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.639008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:35.639909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 239/459] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:35.645322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76ea9-3727-49fe-a9f8-1b42ed2edfd8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.645929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76ea9-3727-49fe-a9f8-1b42ed2edfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.646405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76ea9-3727-49fe-a9f8-1b42ed2edfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.676096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-00d76ea9-3727-49fe-a9f8-1b42ed2edfd8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:35.677298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-00d76ea9-3727-49fe-a9f8-1b42ed2edfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:35.762145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:35.804281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7cabd-7283-49e4-910d-d2609deb0328 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:35.819001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 240/460] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:35.837573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9bad7-59a0-4a20-af93-e02d3d3fd606 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.838192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9bad7-59a0-4a20-af93-e02d3d3fd606 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.838709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9bad7-59a0-4a20-af93-e02d3d3fd606 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.840097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:35.840862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.841082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.841185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 241/461] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:35.841358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.844685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:35.844685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:35.844685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:35.845772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:35.846049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:35.846319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:35.864244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 221/462] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:35.865450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:35.865554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:35.866834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:35.876672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:35.936693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 242/463] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:35.944807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:35.973131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed689c-7d11-472a-b071-c6d009b1693a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.008089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.008855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.009136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.009429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.021445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.023014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c724860f-d27d-4335-8a3c-65e591a7a7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:36.041749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:36.042617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:36.043524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:36.043524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:36.043524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.043524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:36.043524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 222/464] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:36.044200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aecb5-01f9-4909-bdaa-88d40605e742 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.044477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aecb5-01f9-4909-bdaa-88d40605e742 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.045017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aecb5-01f9-4909-bdaa-88d40605e742 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.046388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 223/465] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:36.047282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aecb5-01f9-4909-bdaa-88d40605e742 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.059427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eab6f-76a4-4249-afe7-53a815ec7a35 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.063147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.111758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.112409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.113491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.113491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.114281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.115839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e041b-245d-4eb3-b8a1-09864c81ca10 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.121773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.147090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 243/466] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:35 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:36.147090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.147090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.147090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.160324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:36.161777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:36.180120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aecb5-01f9-4909-bdaa-88d40605e742 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.234948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.236694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.237165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.238254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.241249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 244/467] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:36.242746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.271110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.272923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:36.288995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:36.289944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:36.290803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:36.290803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:36.290803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.290803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:36.293182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 224/468] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:36.294257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.373609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.389723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74249-89f3-46bd-b6db-7c6cffbd3a17 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.432126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087e28-b826-4bb3-9c46-6c49fd49ad29 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.435914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.436549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.436874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.437143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.437937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:36.438241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.440178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.446400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.458548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 245/469] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:36.459475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.473254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.473896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.474172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.474443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.485912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.487331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:36.502482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:36.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:36.504276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:36.504276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:36.504276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:36.504276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:36.504276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 225/470] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:36.504991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.584995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5788a1f-28eb-478f-810b-048b5d560ab5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.621714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.622328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.622601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.622866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.623543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:36.623835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.625228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.638209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 246/471] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:36.638841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.648816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af4d6-53ea-4434-9562-8af2ef61a491 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.656236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.697669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.698293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.698593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.698859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.699538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.701008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.729739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 226/472] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:36 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:36.730599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.781475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:36.805100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b020-204b-4f3e-9ce3-783c45ceabb9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.868255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:36.868950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:36.869229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:36.869498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:36.870194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:36.870492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:36.871894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:36.888136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 247/473] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:36.894309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:36.955610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321fe5d-1186-4cac-904b-e5b47247804b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:36.981594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:37.010831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:37.011655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.011947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.012225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.013164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:37.014914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe2e3-395c-4592-afd9-4e5e5622695a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:37.023006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2fd3-d6a2-4419-8b42-029adfa83b39 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:37.045538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 227/474] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:36 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:37.047034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e7e6-53e5-488d-bd7a-781d147b4a27 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.047387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e7e6-53e5-488d-bd7a-781d147b4a27 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.047731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1e7e6-53e5-488d-bd7a-781d147b4a27 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.049475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 228/475] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:37.058599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.059027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.059401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.074507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:37.075464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.075917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.076382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.077298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:37.078953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:37.089054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:37.090559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:37.110898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 248/476] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:36 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:58:37.193186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 229/477] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:37.218920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:37.348200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc70a3d-e2f6-4d80-9c18-7954be1b27f9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:37.375332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:37.387643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:37.388271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.388549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.388844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.389558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:37.390982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:37.402899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:58:37.402899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:58:37.402899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [parameters: {'id': 'd0ec37beb2b84b2bb0b9b64925e34ff9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:58:37.402899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jul 28 05:58:37.421033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:58:37.421931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:58:37.422823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:58:37.423692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:58:37.424579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:58:37.425925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'id': 'd0ec37beb2b84b2bb0b9b64925e34ff9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:37.426704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:58:37.428035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:37.432048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 249/478] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jul 28 05:58:37 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:37.432186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:37.444683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:37.574233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a13ffb-3ef1-46d5-b184-e7a22f02a293 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:37.618847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:37.619419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.619698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.619967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.630592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c75e1ac5-1edb-4e47-99aa-7d5d5ecefe16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:37.635581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:37.636443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:37.637278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 230/479] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:37.642336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:37.803386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305780-5620-4f4e-894b-449e7ecd5dc9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:37.848371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:37.849335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:37.849796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:37.850247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:37.851172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:37.851654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:37.853231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2c3d8-b3e8-4d77-9975-ff8bc69f6db3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:37.867993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 250/480] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:38.409819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f92ed-5982-48b3-a15b-c90db435e7d8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:38.410026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f92ed-5982-48b3-a15b-c90db435e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:38.410290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f92ed-5982-48b3-a15b-c90db435e7d8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:38.411913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 231/481] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:38.417693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:38.418180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:38.418280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:38.449668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:38.450876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:38.515791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:38.546084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 251/482] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:38.584457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f92ed-5982-48b3-a15b-c90db435e7d8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:38.670281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:38.730708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f92ed-5982-48b3-a15b-c90db435e7d8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:38.775150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:38.776152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:38.776625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:38.777134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:38.793831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:38.799389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:38.801008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:38.801796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:38.804057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 232/483] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:38.810100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:38.973367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a1091-8fbf-4eb8-a253-cc46f49b837b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.023270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.023895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.024174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.024441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.025178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:39.025479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:39.026835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:39.040505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 252/484] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:39.046479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.208542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5006-cdef-471b-9a68-abc12d8bdb9f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.256862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:39.265924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.270072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.270435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.270720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.281997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:39.283457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:39.302276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:39.303146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:39.304006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:39.304006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:39.304006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:39.304006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:39.304006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 233/485] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:39.309241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.372742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:39.443921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66ce9-463d-4fc4-94f0-fa336d6655b1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.489272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.489894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.490173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.490444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.491140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:39.491442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:39.492828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc621a2-d308-4a6e-b78e-92c8bd7b403c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:39.508708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 253/486] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:39.513875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.557533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d1f07-4122-4014-9fde-938bcb7f5993 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.558175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d1f07-4122-4014-9fde-938bcb7f5993 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.558643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d1f07-4122-4014-9fde-938bcb7f5993 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.560577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 254/487] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:58:39.566530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.567178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.567513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.588541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:39.590063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:39.663709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 255/488] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:39.667115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc532-5f58-4bb3-9029-501fa147635f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.683618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.710890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.711686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.712069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.712707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.721634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:39.723337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:39.726587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:39.740025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:39.741004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:39.741906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:39.745369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 234/489] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:39.751090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.828224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:39.829314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787e80d-8547-4ae6-a5a8-b2a293f28301 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.875486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.876663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.877093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.877367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.891415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:39.897565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b9caf-5a90-4c85-8777-d68115fe8584 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9e5c1e5d-8079-4eea-ae51-de170fcde209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:39.898113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:39.898963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:39.899739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:39.901718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 256/490] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:39.901903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e76ac-2fd8-43d0-ae9a-540e1aaeb000 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.903925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e76ac-2fd8-43d0-ae9a-540e1aaeb000 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.903925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e76ac-2fd8-43d0-ae9a-540e1aaeb000 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.903925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 257/491] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:39.904996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d96b1-3fa9-4c81-b57d-fa82fac4865d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.906181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d96b1-3fa9-4c81-b57d-fa82fac4865d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.906181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d96b1-3fa9-4c81-b57d-fa82fac4865d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.907073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 258/492] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:39.907779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d96b1-3fa9-4c81-b57d-fa82fac4865d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:39.938626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:39.939447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.939625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.939899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:39.941444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:39.941725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:39.942994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a6e4-b7c9-48d6-9218-f4c7f8af60cc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:39.987137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 235/493] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:39.987137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:39.987137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:39.987137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.003724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:40.004955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:40.017778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.026481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d96b1-3fa9-4c81-b57d-fa82fac4865d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.061919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.062573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.062853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.063118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.063816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:40.064114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.066169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d8f57-4f29-4165-a484-44ef9d5b9944 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.074644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 259/494] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:40.074778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 236/495] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:40.083590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.083590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.083590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.085032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.100613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:40.101958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:40.122466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.174492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 260/496] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:40.181560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.214127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47aea-c925-40f2-88ff-47b4a05bb094 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.252045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.252692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.253031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.253310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.275613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.292649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14cd58-d408-462b-aa46-85a1290821da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.330480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.332147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.332568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.333150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.333431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.333745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.344744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.346176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.360209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:40.361929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:40.362880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:40.364025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:40.364025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:40.364025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:40.364025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:40.364025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 261/497] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:40.364297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.443211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 237/498] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:40.444404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.475251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43997-c88e-4a59-b308-d4cbb77aa14e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.512795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.513434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.513716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.513986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.521841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.526839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:40.533467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:40.535804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 262/499] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:40.536613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.559794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032da19-6815-446f-a265-c26b6a118efd None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.585380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.594175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.594817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.595098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.595369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.605703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:40.610599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:40.611644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 238/500] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:40.613200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.638073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5faf2e-eede-4837-822a-58e50e620fe9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.671344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.671950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.672229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.672504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.673223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:40.673528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.675480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.687046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 263/501] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:40.687832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.717137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5c13-fcdb-4c01-94a5-da48af0c2ab0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.745145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.752353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.753041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.753321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.753594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.763435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.764925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-315c6ac3-e7d3-4761-99c6-18a1f0f485f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:40.780117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:40.781181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 239/502] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c49b64-3169-4a53-9399-f2196f446862 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c49b64-3169-4a53-9399-f2196f446862 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.783383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c49b64-3169-4a53-9399-f2196f446862 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.785001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 240/503] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:40.785524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c49b64-3169-4a53-9399-f2196f446862 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.791831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a3188-eae8-4928-9250-b3e1c389926e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.827300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.827911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.828065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.828187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.828454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.829197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:40.829497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.830979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.840126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 264/504] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:40.840892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.889561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c49b64-3169-4a53-9399-f2196f446862 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.922472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.923082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.923357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.923630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.924332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:40.924659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.926584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.934904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 241/505] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:40.936005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:40.942257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a822-6715-4cd6-af2c-42786a934965 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:40.961830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:40.975848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:40.976476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:40.976783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:40.977050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:40.984567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:40.986037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-95484a58-dc37-4f40-ba3d-8d7984bdbee1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:40.998766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:40.999829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:41.000804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:41.001527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 265/506] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:41.002905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.003699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.003974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.021249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:41.022434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:41.032906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.036327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c24397-b3d0-442e-9a0b-4f5d3b9876a0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.072884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.073494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.073774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.074044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.074721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:41.075020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.076377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.088728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 242/507] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:41.089551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.099754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 266/508] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:41.099754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.194692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7c97-4272-4662-944f-b16d67494762 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.209609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031550a7-b3c1-4fa2-b28d-648979fec527 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.220113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.228785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.229438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.229719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.229992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.240540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.242023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.245199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.245836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.246114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.246383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.256684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:41.256938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:41.257919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:41.258762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:41.258762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:41.258762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.258762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:41.258762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 243/509] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:41.259027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.259093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.275941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:41.276355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:41.277235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:41.278198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:41.278198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:41.278198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.278198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:41.278198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 267/510] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:41.278980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.366518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992747b-64c5-4b59-95f5-9c6137f866e5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.391557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb9fc-2dac-4ae7-a74d-b7ae02894454 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.401052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.401666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.401943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.402211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.402993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:41.403298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.404756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.422794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 244/511] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:41.423608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.427278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.427909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.428185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.428453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.435369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.436841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:41.449232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:41.450063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:41.450910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 268/512] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:41.451367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.479305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.504227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.538289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e68e9-e8a7-48a4-b958-bb4fbc670f8c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.558052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7f51-ca20-4d2f-bf6b-8e86a3ffcee3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.574022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.574928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.575205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.575472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.585965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.587413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.591822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.592436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.592745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.593021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.593706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:41.594013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.595369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:41.602479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:41.603443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 245/513] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:41.604399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.617955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 269/514] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:41.617955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.694880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.701875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a116458-5d49-42e7-8625-94cf49bdf07c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.714874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff1042-469b-49a1-8935-7e08c5b4ea09 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.725212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.737310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.737929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.738212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.738491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.739179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:41.739485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.740881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.748458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.749096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.749372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.749638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.752540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 246/515] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:41.753364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.820177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.821676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.859468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8fb8-b881-4575-b903-302127042f5a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:41.892601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:41.893168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:41.893939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:41.894223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:41.894976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:41.895281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:41.897110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:41.904562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:41.915031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 247/516] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:41.915844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.925753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 270/517] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:41.927147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:41.961766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.019826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05697ab-90c1-44f4-9efa-ca4c993e36b0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.025713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699380-f770-4315-9f76-ebd4423e2119 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.052892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.053513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.053797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.054071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.054765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:42.055076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.056447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.058931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.059558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.059835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.060103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.067558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.068552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 248/518] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:42.069001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.069417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:42.081759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:42.082693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:42.083832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 271/519] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:42.084394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.131121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.177290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c340ec-c36d-45ff-af8d-c49a957fd038 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.178736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.187959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4c049-9415-47f7-887e-a3fc4869e576 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.214389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.215029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.215306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.215574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.221269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.222014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.222285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.222546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.222653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.223315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:42.223618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.224103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.225027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.240768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 272/520] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:42.240768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:42.241066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:42.242013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 249/521] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:42.243112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.355791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8c62e-7561-4f09-b9a3-520b482f0f3a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.363301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d816e2-1ee2-4056-b0f2-cf4882ea50b9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.364485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.393494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.394145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.394427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.394707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.405542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.406306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.406681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.406791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.407139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.407915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.408226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.410207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:42.423968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:42.425847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:42.426691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:42.426691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:42.426691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:42.426691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:42.426691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 273/522] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:42.426958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.441807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 250/523] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:58:42 2022] POST /identity/v3/users => generated 247 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:58:42.441807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.468509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.573225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b9c7-49ab-410b-a324-b821aa798f02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.577517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d30e-5902-41c0-add6-824a5973836b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.622000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.622619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.622904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.623603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.623957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:42.624411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.625824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.628240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.629120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.629635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.630163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.631161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:42.631664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.633335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.648163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 251/524] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:42.648163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.679820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 274/525] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:42.680699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.704948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.746421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.777508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb643-2737-43ca-8881-8c388e39d251 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.803244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b3898-a342-4d9e-b518-7a1940b66ce7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.823485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.824112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.824386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.824662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.825363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:42.826182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.827862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.840809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:42.841423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:42.841696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:42.841961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:42.843531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 252/526] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:42.844382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:42.926522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:42.928247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:42.950688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:42.962295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77028aa6-03cd-4719-8c88-e1a284385b07 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:42.999263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.000026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.000378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.000761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.006157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.068390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 275/527] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:43.069657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.076576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.077985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.179115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc9c9d-6f85-4361-bd3f-346c7fdb7ee0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.182855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 253/528] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:43.183822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.197399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.218483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.219351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.219765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.220166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.222590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.228876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.230623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:43.244312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:43.245407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:43.246445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:43.253677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 276/529] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:43.254777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.291322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086f9d-3612-4648-bf46-f1b03034dd22 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.326719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.327358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.327639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.327912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.339397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.340893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:43.356503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:43.357590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:43.358587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:43.358587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:43.358587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:43.358587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:43.362355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 254/530] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:43.363224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.369607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59379-61b3-4396-8f69-49d7e7245fe1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.407737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.408796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.409804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.410205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.421951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.423774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:43.439225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:43.440308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:43.441338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:43.441338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:43.441338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:43.441338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:43.443175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 277/531] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:43.444066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.461317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.476157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d3274-32b3-48e9-88ea-37e9dfd1b203 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.484371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.511291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.511909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.512186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.512459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.513337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:43.513586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.515157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.532921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 255/532] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:43.533868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.578996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476473-8297-48ca-ba73-8e940cdd7a48 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.619078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.620070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.620798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.621867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.622673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:43.623332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.625085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.641730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 278/533] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:43.642691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.662653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6a40-0984-43ab-bdb7-c94c31fed727 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.706210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.707229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.708277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.708709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.709525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:43.709942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.712111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.730073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 256/534] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:43.730953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.745094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.753596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:43.767288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d474-0dde-4b88-bdff-7e4a0636e2cc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.805415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.806302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.806635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.806971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.807968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=80869e16da504629b8763a9eb3c4c901) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:43.808343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.809983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.824596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 279/535] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/role_assignments?user.id=80869e16da504629b8763a9eb3c4c901&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:43.825677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:43.860926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05a597-1e37-419a-a9bb-4683a7f985ee None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:43.904776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:43.905803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:43.906224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:43.906641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:43.915617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:43.917719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:43.933191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:43.934267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:43.935248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:43.937329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 257/536] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:43.949923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.046930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0087-1c4f-4922-ab78-cef12b3561e3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.074376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:44.100312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.101359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.109027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.109027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.117056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.118523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:44.133550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11c14b-d05b-4a71-a97f-2ef3814dd2d0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:44.140526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:44.141394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:44.142228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 280/537] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:44.149002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.180198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:44.210784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.211410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.211686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.211955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.212728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:44.213034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.214466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:44.240981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 258/538] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:44.246816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.296743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1785b9-ee9c-452d-8867-f34e552f092a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.334990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.335529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.335805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.336215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.337140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:44.337449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.338895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c23ad4-5ae9-4e6a-ab2c-58ab6b7dddeb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:44.368672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 281/539] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:44.370632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdb51-1db4-48b4-b0f8-275d18d9a5ee None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.371171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdb51-1db4-48b4-b0f8-275d18d9a5ee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.371452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdb51-1db4-48b4-b0f8-275d18d9a5ee None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.372913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 282/540] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:44.373978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cdb51-1db4-48b4-b0f8-275d18d9a5ee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.417152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511736-a5bb-4083-8d8a-d2fee93d45a3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.453003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:44.462395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.463017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.463299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.463574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.464367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=f022f8a1b5364341b0a0cdeaf7bc16e2) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:44.464719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.466172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56726c-e8a5-45ec-9947-abdeef7e5105 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:44.467684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:44.472580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 259/541] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/role_assignments?user.id=f022f8a1b5364341b0a0cdeaf7bc16e2&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:44.474029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3e31c-900c-47da-aed3-4c5207051329 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.474316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3e31c-900c-47da-aed3-4c5207051329 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.474592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3e31c-900c-47da-aed3-4c5207051329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.494139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-42d3e31c-900c-47da-aed3-4c5207051329 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:44.495389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-42d3e31c-900c-47da-aed3-4c5207051329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:44.508268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cdb51-1db4-48b4-b0f8-275d18d9a5ee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.554509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.555126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.555847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.556131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.557215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=86b70241972c476bb596c1634149e69b) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:44.557528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.559141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:44.568236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 283/542] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/role_assignments?user.id=86b70241972c476bb596c1634149e69b&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:44.580930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 260/543] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:44.600595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.715054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d005da-5eaa-4715-a6f8-94645aa03cb6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.741807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb078-458a-486a-812d-20f490375b56 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.742151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb078-458a-486a-812d-20f490375b56 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.742361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb078-458a-486a-812d-20f490375b56 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.749538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 261/544] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:44.754614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348905f7-265a-4fa8-b747-379538668cbe None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.754945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348905f7-265a-4fa8-b747-379538668cbe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.755164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348905f7-265a-4fa8-b747-379538668cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.760155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.760952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.761229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.761498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.766529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:44.775486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-348905f7-265a-4fa8-b747-379538668cbe None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:44.776786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-348905f7-265a-4fa8-b747-379538668cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:44.787088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:44.793058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:44.795299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:44.797339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 284/545] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:44.803112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.916888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 262/546] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:44.941188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58329-64b0-4722-89c4-3dd062e5f2d1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:44.958505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348905f7-265a-4fa8-b747-379538668cbe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:44.990270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:44.990901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:44.991179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:44.991448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:44.992166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:44.992475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:44.993865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.011283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 285/547] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:45.014388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.016763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.062865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348905f7-265a-4fa8-b747-379538668cbe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.085666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.099312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.100008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.100293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.100567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.113849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:45.118974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:45.119919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:45.120720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 263/548] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:45.126491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.136815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d76c6-c836-4835-ad34-1f7c279c2a91 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.173225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.173786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.174073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.174341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.186158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.187635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:45.203097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:45.205594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:45.208741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:45.208741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:45.208741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.208741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:45.208741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 286/549] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:45.210959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.233291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e336d1a-1139-4088-a365-8ba22283b0ba None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.257023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.270157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.270796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.271078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.271354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.272127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:45.272437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.273899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.283239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 264/550] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:45.289307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.324134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a2b86-c4f7-4c5a-a974-8a42b96b294d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.335837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.361734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.362410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.362691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.362959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.363646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:45.363947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.366017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.382499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 287/551] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:45.383982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.397674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4969e-4749-4956-8f61-1a6015a467b5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.433701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.434565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.435003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.435424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.447283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.449051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:45.466414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:45.467578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:45.468855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:45.468855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:45.468855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.468855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:45.470716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 265/552] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:45.476790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.492711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da1bc2-0f87-46e5-b002-6546ed5777a8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.513211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.528703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.529382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.529622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.529894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.537882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.539319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:45.551835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:45.552831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:45.553742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:45.556752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 288/553] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:45.558702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.591160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.599152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b9268-3aec-499e-9d58-efd221c6663c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.673624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.674258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.674585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.674862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.675656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:45.676171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.679434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660ae7-31b5-4a67-b868-bbee9cb1636e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.681863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.706864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 266/554] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:45.713795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.717046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.717901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.718387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.718887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.719894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:45.720403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.722656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.745739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 289/555] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:45.747243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.840991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.852324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889728d-bbbc-4036-9f08-2dd90dde81e4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:45.887410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:45.888374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:45.888889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:45.889475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:45.900172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:45.901933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:45.910322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:45.918112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:45.919074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:45.920430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:45.920430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:45.920430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:45.920430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:45.926996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 290/556] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:45.928398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:45.944041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e69d5-91b8-4992-afa2-a7f612e5c5b4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.005543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.006101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.006375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.006647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.019689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.021169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:46.037677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:46.038644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:46.040153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 267/557] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:46.044268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.130910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2641-adf3-4ff2-b67a-9d0e99013c53 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.187137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.187762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.188034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.188299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.189011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:46.189307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.191068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.200992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.204393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 291/558] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:46.210890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.227596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636b78-b569-43e3-881d-dc718ad825a1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.266224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.266778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.267056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.267326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.268117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:46.268486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.269932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c4713-e9f0-498d-a2ac-1f1fcc0b4e0d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.294871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 268/559] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:46.296486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e3de-704d-4bc1-b65d-91e0b79ef337 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.296828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e3de-704d-4bc1-b65d-91e0b79ef337 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.297100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e3de-704d-4bc1-b65d-91e0b79ef337 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.300712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 269/560] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:46.301741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e3de-704d-4bc1-b65d-91e0b79ef337 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.307318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.340910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4af23-51e0-4575-82c2-3674f216de2d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.376625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.377161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.377433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.378302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.385374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.386944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4685f32b-0ced-4c15-a78d-4a50db0f4e6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:46.399918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:46.400956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:46.402470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 292/561] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:46.402967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.403208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.403358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.418256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e3de-704d-4bc1-b65d-91e0b79ef337 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.423574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:46.424956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:46.459318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.460336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.460850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.461363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.487357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.509001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 293/562] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:46.509883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.544393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.546276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.549976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.628528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddca03b-cb7a-4963-bd48-d69d638bd3d9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.655180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 270/563] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:46.656492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.666808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.667567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.667776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.668046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.668822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:46.669124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.670636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.683757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 294/564] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:46.684676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.740690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.763524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f5415-9fbe-49c4-a3b3-8cec6935826e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.766708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.799108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fc9a-1030-49de-96b2-99e8597877bf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.801913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.802811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.803293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.803790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.815847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:46.823610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:46.824547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:46.826150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:46.834872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 271/565] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:46.835900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.836299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.836546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.836850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.837121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:46.850067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:46.851912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:46.873885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:46.874861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 295/566] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:46.876327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:46.951105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc780ae6-cdcb-49e6-a02c-75da5f49e579 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.987647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94704212-d124-4726-bd54-12d2753f94f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:46.988922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:46.989164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:46.990026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:46.990558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:46.991038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.006975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=b65b1e894e3d4d2eb08b7cddfeff1822, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.008818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.024739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 272/567] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:46 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:47.026025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.027286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.027909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.028185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.028507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.029284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:47.029647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.031256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.042373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 296/568] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:47.056624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.058439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.164314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea53b1-5940-4ffc-89a1-191f7e42c334 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.216317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.217228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.217682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.218100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.218949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:47.219399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.220958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed811ad-9e2a-4484-ac76-fe7febab7374 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.233175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 273/569] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:47.234709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9b596-b0b3-4859-90a5-1bf73fc8238e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.235202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9b596-b0b3-4859-90a5-1bf73fc8238e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.235620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9b596-b0b3-4859-90a5-1bf73fc8238e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.237868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 274/570] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:47.239158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605605f6-e635-4119-ba4e-d9eccc994e88 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.239638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605605f6-e635-4119-ba4e-d9eccc994e88 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.240058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605605f6-e635-4119-ba4e-d9eccc994e88 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.241791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 275/571] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:47.243326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3120-9858-4e9a-9a8f-8210f9a625d9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.243757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3120-9858-4e9a-9a8f-8210f9a625d9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.244246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f3120-9858-4e9a-9a8f-8210f9a625d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.258604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19f47-0f00-42ff-8bd0-37770173827e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.263033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f08f3120-9858-4e9a-9a8f-8210f9a625d9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:47.264327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f08f3120-9858-4e9a-9a8f-8210f9a625d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:47.296100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.297029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.297317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.297638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.308607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.312429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:47.327595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:47.328488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:47.329489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:47.329489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:47.329489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:47.329489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:47.334162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 297/572] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:47.335006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.343639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 276/573] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:47.345955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.346238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.346546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.353910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.359848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.367339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:47.368573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:47.437749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 277/574] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:47.438688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.461945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e04dac-4e29-4f3d-a35d-2c015cf9d92a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.498953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.499765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.500136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.500501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.510130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.511736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:47.527879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:47.528975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:47.529840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:47.535945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 298/575] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:47.535945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.550650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6e80-6d3c-4e24-abcc-961695314528 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.588797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.589347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.589628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.589901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.590595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:47.590937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.592305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.594048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.607704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 278/576] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:47.608536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.622904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.648147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3be22-49aa-48a9-88ae-22dc82cac35a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.694048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.694683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.694954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.695587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.706896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:47.712668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:47.713701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 299/577] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:47.714586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.727389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd874bd-14f2-4b3e-9da7-04c4ac668ffa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.764841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.765474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.765761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.766015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.778414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:47.786081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:47.787048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:47.787902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 279/578] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:47.788599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.829912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b9cda-eec7-4745-864c-a64197b54cc1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.848773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.866158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.866767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.867044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.867311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.868049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:47.868351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.869807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.872258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:47.882639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 300/579] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:47.886272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.902744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa518ba-7fd3-4957-abb2-010cd7757b63 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:47.939658 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:47.941216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:47.941680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:47.942149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:47.950379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:47.952164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:47.965494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:47.966618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:47.967766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:47.974537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 280/580] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:47.975570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:47.985901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f85a7-7bd2-4dc4-be70-3de02a288af1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.024261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.024895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.025173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.025460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.026133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.026538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.027767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.036675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 301/581] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.041402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.087344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ea96-b38d-4a12-9574-1dd151b0e48b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.103503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.108484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.125834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.126544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.126894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.127236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.128057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.128534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.129781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.137976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 281/582] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.138878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.162601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2c418-fde2-4f96-b3ff-c455abd2e716 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.199737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.200612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.200917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.201187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.201970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=cc4333399bc542e39a9f4d794dcccdf1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.202276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.203681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.211061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 302/583] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/role_assignments?user.id=cc4333399bc542e39a9f4d794dcccdf1&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.212437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.264966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fca0b-d7f8-4093-a98e-a664486e1c0d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.304175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.304843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.305120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.305394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.306212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.306522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.308105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.332178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 282/584] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.332178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.375616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.382034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bf822-8d68-448b-bc4f-6981be944796 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.419209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.435562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.436466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.437406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.438108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.453796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.456528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.464045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34055-99ae-415a-8f5b-720531781419 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:48.476284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:48.477427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:48.478528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:48.478528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:48.478528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.478528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:48.481131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 303/585] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:48.485486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.516046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.517159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.517542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.517938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.532394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.534146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:48.553532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:48.554484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 283/586] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:48.559821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.631171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953e91-bb5b-4fd8-9d50-ad4690a9bba5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.674240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.686015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.687135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.687422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.687698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.693655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a15fee-091c-4359-a018-6fb91c9e86fb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.705303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.708279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:48.729009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:48.729956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 304/587] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:48.731743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.736396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.737354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.737840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.738340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.739306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.739836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.741538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.755402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 284/588] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.759460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.766886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:48.853378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943082d8-0179-43ad-8d14-b9e1e9590f1a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.884276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66aee-231f-45c2-aa9a-cf2ed7f7ae6e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:48.898787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.899499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.899809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.900085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.900962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.901265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.903274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.921119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 305/589] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.921119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.929432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:48.930401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:48.930906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:48.931384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:48.932285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:48.932878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:48.934463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:48.947232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 285/590] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:48.948487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:48.958686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.024362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.043996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69fe0d-49ac-4906-878c-719075f349d0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.073176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685783-1a4e-4061-b3cf-e63d17a019c0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.090030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.090672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.090951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.091223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.099329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.100822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:49.113460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.114577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:49.115721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:49.116515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 306/591] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.117266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.123748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.124400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.124751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.125030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.135915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.137526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-75b6767a-619a-41eb-8787-01202afb55e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:49.153248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.154192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:49.155110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 286/592] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0e00-10c5-415f-8fa7-26d955aa7753 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0e00-10c5-415f-8fa7-26d955aa7753 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b0e00-10c5-415f-8fa7-26d955aa7753 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 287/593] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:49.161318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b0e00-10c5-415f-8fa7-26d955aa7753 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.226921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a6c02-f3d6-4ea1-b673-0bbfc7a369c4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.242776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.262830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.263550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.263897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.264236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.271105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.272523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.281463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b0e00-10c5-415f-8fa7-26d955aa7753 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:49.286746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.287615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:49.288528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:49.292722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 307/594] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.293569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.303135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.324548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.326433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.326719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.326989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.327792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:49.328101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.329570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92df31-ffe8-4254-b076-c3f119441581 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.348067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 288/595] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:49.349405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.349687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.349956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:49.370001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:49.411412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358670-d1c9-490c-94d7-e4c4af56dd26 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.435741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 289/596] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:49.436579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.454779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.456932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.457504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.458474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.459669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:49.460206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.462323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.487326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 308/597] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:49.487326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.505130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.552424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.554860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876b9e-4d09-4484-a650-38a9411f2725 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.593974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.593974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.593974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.594333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.595155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:49.595470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.597375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d917-da94-4472-8c12-2e3b73ccd160 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.597531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.611556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 290/598] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:49.617804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.637810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.638453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.638731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.638997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.649481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.651122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:49.670347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.671265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.672159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:49.672159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:49.672159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:49.672159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:49.672159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 309/599] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.672519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.731012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6e973-b284-440b-87a3-29a909a179d7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.745473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.767245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.767884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.768162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.768463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.778418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919bc4a-f5b1-4fc2-8d1c-a49f719e9167 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.778880 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:49.784687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.790873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 291/600] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.791794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.803486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:49.824196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.824970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.825322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.825724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.837570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.839112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:49.854524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:49.855632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:49.856779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:49.856779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:49.856779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:49.856779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:49.857518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 310/601] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:49.858211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:49.907565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b747-4d7a-4bed-83dc-676c526e15a6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.946911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:49.947491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:49.947770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:49.948047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/80869e16da504629b8763a9eb3c4c901/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:49.963761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=80869e16da504629b8763a9eb3c4c901, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:49.965373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:49.966493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3ce01-6001-4664-acf3-541feab7318a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:49.980478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 292/602] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:49 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/80869e16da504629b8763a9eb3c4c901/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:49.994573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.006909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.007659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.007936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.008205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.009188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.009333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.010796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.029984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 311/603] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.029984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.042312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.066438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.129554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca44a33-0125-4cf8-bf57-fe12069d7cbb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.164506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091b580-6bdb-485b-846b-63f19a548375 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.172818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.174069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.174069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.174069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.175727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.176091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.178215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.188549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 293/604] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.189426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.213065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.213823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.214215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.215058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.216131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.216537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.218092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.235447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 312/605] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.236530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.293481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.311500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4336580-a9bf-46bd-a860-a1f3d521a217 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.341558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.347521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.348245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.348619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.349017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.355915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.356705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76bb9-df47-4ab9-909e-bfa431af37c7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.357375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:50.368800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:50.369945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 294/606] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:50.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.401759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.402398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.402917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.402917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.414624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.416070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ea5ea050-1556-4ad9-8f68-b27510335a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:50.431538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:50.432472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:50.433385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:50.433385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:50.433385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:50.433385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:50.433385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 313/607] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:50.434112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85010081-c167-467f-b8a5-280c1718c570 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.434112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85010081-c167-467f-b8a5-280c1718c570 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.434385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85010081-c167-467f-b8a5-280c1718c570 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.439812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 314/608] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:50.439812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85010081-c167-467f-b8a5-280c1718c570 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.484282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940947-ce39-479f-9e42-25c40e665e4f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.526910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.527521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.527849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.528119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.535463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.536820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:50.548407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:50.549537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 295/609] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:50.550455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.557491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85010081-c167-467f-b8a5-280c1718c570 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.560877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.593971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.594585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.595213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.595213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.595862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.596168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.598160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd03102-a32b-470a-8009-b328466d916f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.607713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.617623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 315/610] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.618745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.619675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.619943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.637402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:50.638817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:50.667365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79fd96-2ddc-445b-9f99-b9bdfc9264a9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.707461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.708334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.708606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.708897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.709585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.709883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.711240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.724181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 296/611] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.725044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.730030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 316/612] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:50.730840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.799185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.835291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f19891-5d46-445b-8ecf-e04c8501f4a9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.835860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6d38d-35e0-406a-955b-14804a61db01 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:50.864263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:50.870340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.870954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.871224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.871415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:50.871536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.872209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:50.872300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:50.872510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.872756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:50.873116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/f022f8a1b5364341b0a0cdeaf7bc16e2/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:50.873970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.887853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 297/613] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:50.889906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:50.890286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=f022f8a1b5364341b0a0cdeaf7bc16e2, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:50.891938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:50.907386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 317/614] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:50 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/f022f8a1b5364341b0a0cdeaf7bc16e2/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:50.908623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.018274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab441724-0e7c-4ddd-931a-3a753ba07615 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.036927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c687fdb-5a20-447e-9d9f-3eff3506e063 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.051733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.063424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.064077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.064356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.064624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.075725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.077808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.092362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:51.092591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:51.093736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 298/615] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:51.094889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.104032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.104032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.104032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.113163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:51.119995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:51.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:51.122246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:51.124449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 318/616] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:51.126062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.176044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.243630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec052-3732-476b-a0cf-82d3c20e84ae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.244077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809c77-6d30-40df-911e-a45ca9712578 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.280309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.281109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.281480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.281876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.282818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:51.283217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.284937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.288682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.289374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.289646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.289918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/86b70241972c476bb596c1634149e69b/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.306712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=86b70241972c476bb596c1634149e69b, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.308247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.308631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 319/617] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:51.309599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.329391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 299/618] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:51 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/86b70241972c476bb596c1634149e69b/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:51.330344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.373455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.446301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c11261-09ae-4203-9709-a12a77644c82 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.500915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.510117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e45fad-3321-4f93-a0d0-798052aa687d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.532824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.533639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.534623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.536981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.572151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.572718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.573001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.573270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.574083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:51.574389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.575850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.586537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 320/619] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:51.593313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.628993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.630719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.678245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.709657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d948-8826-459a-8b96-11dedac70ae9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.762299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 300/620] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:51.768044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.793358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.794264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.794729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.795147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.817718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.819440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:51.847211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:51.848586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:51.849536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:51.849536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:51.849536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:51.849536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:51.849536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 321/621] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:51.853970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:51.881533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0888623-720d-4897-bb93-62191edf0166 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:51.898877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.923340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:51.923980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:51.924256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:51.924707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:51.927491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:51.938280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:51.939831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:51.958202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:51.960241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:51.962377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:51.962377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:51.962377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:51.962377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:51.968661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 301/622] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:51.970491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.078238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeedad-9c1f-4fa9-a9ac-7168f8218154 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.135683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.136306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.136580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.136868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.137561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:52.137854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.139202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.156458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 322/623] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:52.162663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.181853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac3c0-abb2-4395-b970-5607c8b99971 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.220517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.221229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.222221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.222532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.223258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:52.223559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.224978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.239311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 302/624] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:58:52.244993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.275496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.296695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.311468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140be77-f455-48ac-8f6c-dc3d0046e3f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.351348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f58e5-a1aa-4eac-acac-24fcf6572d76 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.357026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.357672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.357949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.358221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.366563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.368088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a09707a1-f83e-405f-9aa5-e19da565ea35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:52.380755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:52.381717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:52.382666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 323/625] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:52.383684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8bbc-9e82-4c40-bc9f-ba64f3ec9af3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.383963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8bbc-9e82-4c40-bc9f-ba64f3ec9af3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.384227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8bbc-9e82-4c40-bc9f-ba64f3ec9af3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.385779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 324/626] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:52.387696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.388340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.388622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.388924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.391174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.391598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.392092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.396335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.397818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.412461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:52.414002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:52.414540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:52.415591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:52.416624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:52.418074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 303/627] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:52.421434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.491353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 325/628] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:58:52.492346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.538314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba0e80-86fd-4211-aa08-50f85633a52e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.547457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.565502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.573869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.574490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.574768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.575105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.575896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:52.576203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.577809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.597239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 304/629] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:52.598156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.606518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e3fa-7601-4288-b94e-45c2b01af702 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.646802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.647747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.648223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.648807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.649711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:52.650184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.651919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.670332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 326/630] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:52.671486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.700317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47debe-0bd4-4519-8df6-95dd49c73df1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.737775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.738432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.738730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.738998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.750182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:52.755854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:52.757001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:52.757910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 305/631] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:52.758607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.788080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.791121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf990a-4bf5-4b3b-b7c0-db13eba5bf4f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.817048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:52.833511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.834391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.834825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.835266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.847451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.849619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.864034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806bd43-f823-48d9-a946-192ac5ab1089 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:52.866507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:52.867525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:52.868580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:52.868580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:52.868580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:52.868580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:52.870531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 327/632] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:52.871668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:52.899287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:52.899939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:52.900211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:52.900530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:52.901392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:52.901700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:52.903127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:52.916687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 306/633] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:52.916687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.040333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.054344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580add-45c9-42cd-b6f6-a2fd6fc89d13 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.079606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f554a-81c8-45d4-9bf0-3214a8611265 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.119856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.120880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.121392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.121962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.122913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:53.123433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.125549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.129672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.130346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.130621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.130894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.131589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:53.131887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.133725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.137438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 328/634] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:53.145887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.155396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 307/635] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:53.161046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.187025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.268501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca1dc-9e94-4a96-bf4a-0aeb8c81e1f9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.302503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e588f2-a21e-4ff0-b420-8d8269e7c8ca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.311283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.312702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.312702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.312702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.324713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.326390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f97e8086-8aee-4fa8-a07a-6db58967d0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:53.343235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:53.344177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:53.345175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:53.345175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:53.345175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:53.345175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:53.347672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 329/636] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:53.349187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc19f1-0cc2-4201-861c-eabefed691cf None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.349651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc19f1-0cc2-4201-861c-eabefed691cf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.350077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc19f1-0cc2-4201-861c-eabefed691cf None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.351732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 330/637] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:53.354723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc19f1-0cc2-4201-861c-eabefed691cf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.356852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.360946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.361224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.361490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.371952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.373979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-51cf62ff-8ad9-4a07-9028-b06bb016f46e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:53.390176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:53.391093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:53.391992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:53.394132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 308/638] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:58:53.396081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.396349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.396615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.415646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:53.416857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:53.420492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.485018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.496663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 309/639] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:53.496663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.517398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc19f1-0cc2-4201-861c-eabefed691cf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.562478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.563453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.563935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.564451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.566357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:53.567133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.569170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.584101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 331/640] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:53.585275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.621649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585de7-5207-4aa6-851e-2a76d85829dd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.659929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.660511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.660837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.661106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.662126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:53.662248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.663655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.673035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.677990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 310/641] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:53.678935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.695825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89f0c3-9e8f-47fa-ae91-0f4ec0bfb7fc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.732429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.733281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.733658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.734023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.744972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:53.749907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:53.751103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:53.752147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:53.754577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 332/642] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:53.755397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.768371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.795172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec97f-d5ec-4c8d-9187-6a673d0ce4cc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.831759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.832399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.832699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.833228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.840953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.842402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9ea8a826-ff1f-442e-9f32-abe7c4a0655f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:53.854048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:53.855004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:53.856083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 311/643] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:53.856725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f200-4a40-4406-824c-5b1912782236 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.856725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f200-4a40-4406-824c-5b1912782236 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.857348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320f200-4a40-4406-824c-5b1912782236 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.862095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 312/644] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:53.862095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f200-4a40-4406-824c-5b1912782236 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.875619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336167-7f6c-4332-a4c5-aae3b93b9ad2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:53.913209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:53.913821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:53.914100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:53.914370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/cc4333399bc542e39a9f4d794dcccdf1/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:53.929752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=cc4333399bc542e39a9f4d794dcccdf1, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:53.930995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:53.931182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:53.956135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 333/645] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:58:53 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/cc4333399bc542e39a9f4d794dcccdf1/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:58:53.956135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:53.980113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320f200-4a40-4406-824c-5b1912782236 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.018948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.019586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.019890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.020157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.020912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:54.021218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.022693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da9e24-af04-4622-82ed-a58308e23148 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.037243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 313/646] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:54.038700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1576-812a-4094-9c9b-6204865c206c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.038988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1576-812a-4094-9c9b-6204865c206c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.039261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1576-812a-4094-9c9b-6204865c206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.041883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.059719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-122d1576-812a-4094-9c9b-6204865c206c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:54.060956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-122d1576-812a-4094-9c9b-6204865c206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:54.114165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6866962-49cc-4b43-9ddf-63aebae92d98 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.150994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 314/647] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:54.151927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d1576-812a-4094-9c9b-6204865c206c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.160003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.161007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.161493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.161966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.162978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:54.163571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.166002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.187271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 334/648] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:54.188455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.210310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.273603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d1576-812a-4094-9c9b-6204865c206c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.311918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.312957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.313336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.313742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.326618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.328238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.332509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5889-3ddc-494e-b5ec-4f9328e75b2a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:54.344214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:54.345207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:54.346080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:54.346080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:54.346080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:54.346080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:54.346080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 315/649] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:54.347808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.354519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.375356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.376399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.376884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.377333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.389565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:54.395557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:54.396478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:54.397350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:54.404717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 335/650] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:54.405773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.457200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94005-c0de-46ec-9304-0aa327b4ab03 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.459872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.494962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.495700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.496152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.496501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.521893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253efdb-dde1-436c-a8f3-54af52e7066e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.563814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.565593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.566326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.567120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.568319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:54.568866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.570613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.573517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.575444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.589313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 336/651] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:54.590383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.679248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 316/652] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:54.680428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.681070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.684581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.707342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80dd8-54a3-46c2-9b6c-db9da40e323b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.745576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.746496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.747059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.747567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.748541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:54.749139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.750687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.760620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 337/653] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:54.761836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.798257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effc0bf-c96b-4e4d-bc48-318754f89773 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.843431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.844615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.845104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.845683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.856015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.857755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:54.875591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:54.876619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:58:54.878249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:54.878800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 317/654] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:54.879716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:54.892957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.899592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739339-5224-4490-9b9b-cf4a3c12592b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:54.941776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:54.942548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:54.942827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:54.943483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:54.956890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:54.959206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:54.961573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:54.977213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:54.978173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:54.979076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:54.979076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:54.979076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:54.979076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:54.983548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 338/655] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:54.984395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.015052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7bba-3afb-41c7-902d-756237e23d96 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.063121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.064146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.064711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.065240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.078722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.083173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:55.100909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:55.101811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:55.102731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:55.102731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:55.102731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:55.102731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:55.106839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 318/656] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:55.107597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.120420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529bc6-d788-4515-a5cb-1119d714fcca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.159835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.160876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.161497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.162097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.163089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:55.163625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.165418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.187318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 339/657] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jul 28 05:58:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:55.188545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.200124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.220634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df898524-b68a-4786-a0ea-9db5110221ca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.242047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.263047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.263676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.263959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.264237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.264960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:55.265265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.266657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.279956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 319/658] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:55.280798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.305686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b71932-0abc-463c-b121-97ef69129713 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.341201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.341815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.342081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.342349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.343025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:55.343327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.344715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bdfba-65dc-4878-958e-983f4717798a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.357904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 340/659] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:55.358929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165b2d-764e-438b-b2e7-b77a7a513c73 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.359214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165b2d-764e-438b-b2e7-b77a7a513c73 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.359483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81165b2d-764e-438b-b2e7-b77a7a513c73 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.364691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 341/660] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:55.364691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81165b2d-764e-438b-b2e7-b77a7a513c73 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.393386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf0ac-5144-4e42-a92d-91b446de468a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.434185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.435069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.435341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.435608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.438357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.473676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81165b2d-764e-438b-b2e7-b77a7a513c73 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.492157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.509841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.510472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.510743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.511004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.517846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.519685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.519886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.521181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3939b-1338-4814-8bc3-b8ae4e7c259d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:55.531388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:55.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 342/661] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:55.533612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.638726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 320/662] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:55.640013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786275-ed33-491f-9446-58b74142256e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.640293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786275-ed33-491f-9446-58b74142256e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.640564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05786275-ed33-491f-9446-58b74142256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.640978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964a79-300c-4f18-b427-88d8fb0995a5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.659853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-05786275-ed33-491f-9446-58b74142256e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:55.661120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-05786275-ed33-491f-9446-58b74142256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:55.675631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.685048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.685909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.686408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.686897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.696254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.697797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:55.709983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:55.711250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 343/663] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:55.712283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.749058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 321/664] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:55.749976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05786275-ed33-491f-9446-58b74142256e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.761790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.822481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f10eb-223c-45f9-82c4-649de1e69efe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.857232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05786275-ed33-491f-9446-58b74142256e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:55.857569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.858184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.858461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.858742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.860083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:55.860083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.861200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.878903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 344/665] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:55.878903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.900099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:55.900773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:55.901050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:55.901318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:55.914577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:55.916023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:55.927791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:55.935877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:55.936837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:55.937741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:55.937741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:55.937741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:55.937741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:55.937741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 322/666] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:55.938014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:55.986436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c48a5-0491-4170-a45b-8c8ad2e5bcba None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.011832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.022385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.023670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.024140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.024415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.025231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:56.025634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.027114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.047176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 345/667] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:56.048282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.066205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488da80-3e97-4c6e-bdf0-22cdd4a23f9f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.110310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.111009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.111292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.111566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.121595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:56.126892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:56.128034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 323/668] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:56.134070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.153651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a99a26-6fdb-4509-96b7-8c7ff0d45166 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.162144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.189362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.189993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.190271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.190767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.191311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=80869e16da504629b8763a9eb3c4c901) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:56.191618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.193066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.198645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 346/669] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/role_assignments?user.id=80869e16da504629b8763a9eb3c4c901&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:56.199412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.232135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec4c2-a9ee-4b2b-8319-2eb0dcc19050 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.253863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.273967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.274797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.275082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.275351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.276060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:56.276367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.277805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce566bf3-d9b3-4040-8672-ae272551b99e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.298312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 324/670] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:56.300362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7997-2310-4592-9a73-de1aca28cdaf None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.300674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7997-2310-4592-9a73-de1aca28cdaf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.300949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b7997-2310-4592-9a73-de1aca28cdaf None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.302995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 325/671] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:56.303804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b7997-2310-4592-9a73-de1aca28cdaf None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.340376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae0b34-d04b-44f3-9a3f-9618554a3348 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.389997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.390601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.390865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.391132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.433267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.435514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b7997-2310-4592-9a73-de1aca28cdaf None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.468409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.469880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0402d13-3296-46b1-83de-2ac8a3094d54 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.472033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.472673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.472963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.473231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.473938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:56.474239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.475593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.483894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 326/672] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:56.484778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.537166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.590452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 347/673] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:56.591946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.592420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.592890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.606886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80720-81cf-44a2-bd24-9fd661e74d97 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.611524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:56.613334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:56.642159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.642808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.643125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.643523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.650863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.652374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:56.665216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:56.666137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:56.667030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 327/674] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:56.668120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.693460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.700765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 348/675] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:56.702043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.773778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.777187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cde7c-a8df-466c-a31f-964348f665f5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.813213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.813766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.814131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.814318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.818767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5434-48ea-400e-bbbc-fa773b302d05 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.826345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.827805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:56.843556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:56.844590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 328/676] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:56.845798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.860511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.861182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.861463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.861733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:56.872291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:56.873748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:56.888659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:56.889595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:56.890489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:56.890489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:56.890489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:56.890489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:56.890489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 349/677] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:56.891321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:56.945961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:56.954785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce90bd-9c9f-4edd-9277-b618632e39fa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:56.998309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:56.999206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:56.999501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:56.999775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.002233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.003363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.004845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.005142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237c6a-797c-4b05-bc7e-ba392c2178cd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.029478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 329/678] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.029478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.040872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.041506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.041783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.042080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.048573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.053494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:58:57.059832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:57.060798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:57.061651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 350/679] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:58:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:57.062359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.152276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00de60-0842-4ee4-99b2-cc80c8071276 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.168015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc51d-d990-410f-a410-658b6de98d98 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.182496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.187720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.188627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.188922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.189188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.189874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.190378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.191950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.203575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 330/680] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.204570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.209663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.210387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.210757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.211118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.211896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.212290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.213914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.228024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 351/681] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.228924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.284543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.317270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ab80-9747-4de9-98d6-5940ca4a4ae8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.338680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b214a2-e311-42b2-bbdb-67a4f0cdc0fd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.364580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.365382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.365832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.366297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.367657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=f022f8a1b5364341b0a0cdeaf7bc16e2) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.368173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.370680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.390087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 331/682] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/role_assignments?user.id=f022f8a1b5364341b0a0cdeaf7bc16e2&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.390087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.403561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.404198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.404473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.404780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.405515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.405821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.407241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.421854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 352/683] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.422848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.463698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.531637 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6939dc-2f76-41fb-8182-f5e1abb71b88 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.539208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2f95-f962-4e1e-8a2d-883db64dc4a7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.580312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.580953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.581605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.581605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.587243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.588063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.588480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.589172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.589859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.591364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.592592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.599034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.600841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:57.604930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:57.605841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:57.606764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:57.610709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 353/684] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:57.611540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:57.617747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:57.618851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:58:57.619976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:57.622110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 332/685] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:57.623011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.740189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.748832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367655fb-78f2-4aee-901d-b51b177547c3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.751938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f3b2-c445-4e2a-ac27-deb995d16ccd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.784697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.785386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.785597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.785893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.786609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.786914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.788546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.797453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.798812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.799610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.800028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.806055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 333/686] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.806963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.813213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.815450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:57.836867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:57.837970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:57.839062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:57.839062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:57.839062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:57.839062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:57.841505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 354/687] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:57.843060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:57.870994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:57.918494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a76b-2faf-4e0f-98ea-b77cae1dddae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.964821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:57.964821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:57.964821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:57.964821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:57.965244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:57.965244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:57.965688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:57.977973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba6d2d-67c5-409e-bb6c-cb9fac9d134c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:57.985891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 334/688] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:57.987840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.017086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.018108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.019143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.019725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.020591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=86b70241972c476bb596c1634149e69b) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:58.021005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.022610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.032955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 355/689] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/role_assignments?user.id=86b70241972c476bb596c1634149e69b&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:58.033984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.070347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.148090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a6359-f3d7-4772-bd96-77075fdf48e4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.165870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.190186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.190821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.191100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.191375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.192247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:58.192562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.194249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.208446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 335/690] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:58.213697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.267832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811ab3d-c1b7-4009-9d4e-494484175f92 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.317079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.318039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.318869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.319323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.355491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007450e-95e9-4fd7-b922-8dee40d68301 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.396483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.397485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.397949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.398462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.409923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.411676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-18d331d0-7114-44d9-b8e1-2fb8bb5437e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:58:58.425446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:58.426535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:58:58.427554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:58.430455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 336/691] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:58.430455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441810-09e3-4cd4-9390-41604ea2ef4a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.430455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441810-09e3-4cd4-9390-41604ea2ef4a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.430455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb441810-09e3-4cd4-9390-41604ea2ef4a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.431163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 337/692] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:58.436287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb441810-09e3-4cd4-9390-41604ea2ef4a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.476276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.518876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.520417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a2a99-df6d-4cb0-a2ba-dcab4c5cf5b3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.532307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.562029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb441810-09e3-4cd4-9390-41604ea2ef4a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.614990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.616776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.617090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.618157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.618969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:58.619277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.620747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.638124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 356/693] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:58.638124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.638374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.638639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.645013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 338/694] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:58.647259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.657934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:58.659249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:58.742612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 357/695] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:58.743809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.774126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.784059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4867d-fd09-461a-ae8f-cc12f8edd8e6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.799415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:58.821024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.821762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.822129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.822478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.836510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:58.839044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:58.857173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:58.858078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:58.858966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:58.858966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:58.858966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:58.858966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:58.860712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 339/696] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:58.861709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:58.879356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ed178-3c05-42c2-88b5-f64a80aaa7fa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:58.922949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:58.924105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:58.925225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:58.926025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:58.987380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237a84-df3b-441f-a356-eeab23632659 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.021695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.023223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.032619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.034095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.034572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.035422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.036510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.038345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:59.055131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:59.056124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:58:59.057000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:59.058650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 340/697] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:59.059069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.071677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.074744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.147453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 358/698] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:58:59.148352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.210793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1edf6-c710-4552-82c8-f3441d36bbcf None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.249188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.250040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.250547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.250757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.251551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:59.251956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.254129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.269415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a53b-a0f7-4caf-b38c-28d51fdb5de1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.270980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 341/699] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:59.271967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.318442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.319575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.320015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.320419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.321522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:59.322434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.324194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.331283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 359/700] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:59.333118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.337644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.345873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.388063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda2130-6262-4da0-ae32-0ed343f1c05a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.434514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.435932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.436612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.437101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.453603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.456463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.457003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e74be-8c61-46a9-9426-ff9d0681bc2c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:58:59.474465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:59.475485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:59.476348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:58:59.476348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:58:59.476348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:58:59.476348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:58:59.476824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 342/701] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:59.477678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.502724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.503752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.504162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.504593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.512217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.514128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:58:59.526457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:58:59.527392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:58:59.528304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:58:59.530618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 360/702] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:58:59.531631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.584200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ee2f-c039-4842-ac18-e283c3f216fa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.608015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.613934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.629088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.629722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.630000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.630270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.630957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:59.631263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.632626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.638644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 343/703] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:59.639285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.660679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5809c-ae40-4819-818e-7b112cfc11fb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.700274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.701333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.701863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.702365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.703328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:59.703820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.706139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f556ebd-a9bf-4547-b4cc-edab04bd6f64 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.720745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 361/704] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:59.722993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874dc87-7300-407d-9287-5969a4b29082 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.723422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874dc87-7300-407d-9287-5969a4b29082 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.723956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874dc87-7300-407d-9287-5969a4b29082 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.725521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 362/705] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:58:59.734105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.734393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.734654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.761196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:58:59.762395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:58:59.786388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76b15-a040-4f69-8e8e-9494b542c9c3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.835212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.835968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.836254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.836519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:58:59.837318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:58:59.837628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:58:59.839062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:58:59.842572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 363/706] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:58:59.843420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.855934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 344/707] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:58:59.862244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:58:59.908478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.917922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:58:59.959846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1163139-be27-4ecc-8dc6-faf902844d57 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.992399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d1b56-67ba-4212-9274-3659a917f2c2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:58:59.998038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:58:59.998806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:58:59.999188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:58:59.999578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.009406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.011512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:00.028696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:00.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 364/708] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:00.031016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.039981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.040607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.040927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.041197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.041990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:00.042293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.044329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.054856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 345/709] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:58:59 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:00.057132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.180332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8634-2302-46e2-805b-3cf193fb13c7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.196691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:00.225342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.225998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.226273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.226537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.227164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.228521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:00.242155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:00.243274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:00.244183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 365/710] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:00.251233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.273523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7d6c5-42ae-4aaf-aef2-c344246155d0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.284723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:00.375382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ee18-8ea2-44e2-8dc8-4e1c7fc598a2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.380087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.380926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.381368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.381800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.382702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:00.383169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.385234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.410624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 346/711] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:00.417810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.435134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.435755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.436030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.436330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.437099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:00.437399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.438747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9b71-7d4e-4b86-a7ea-598a166e0367 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.443619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 366/712] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:00.444843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78bce8-ec53-4c31-9d9e-e989eadcbe1d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.445119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78bce8-ec53-4c31-9d9e-e989eadcbe1d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.445383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78bce8-ec53-4c31-9d9e-e989eadcbe1d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.450788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 367/713] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:00.451828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78bce8-ec53-4c31-9d9e-e989eadcbe1d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.504854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:00.538170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07512f-c228-4da4-a7ce-eed2df8ca08e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.569196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78bce8-ec53-4c31-9d9e-e989eadcbe1d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.575744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.576379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.576671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.576952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.577741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=cc4333399bc542e39a9f4d794dcccdf1) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:00.578052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.579602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece199-d14b-4841-b8c0-2e6760e76adb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.592662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 347/714] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/role_assignments?user.id=cc4333399bc542e39a9f4d794dcccdf1&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:00.592662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.592662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.592662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.608524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:00.609904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:00.623566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.624474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.624784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.625056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.625744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] RBAC: Adding query filter params (type=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:00.626220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.628796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.635950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 368/715] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:00.658133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:00.733128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 348/716] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:59:00.778875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:00.898341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13344ff-f9a6-476a-a9b4-3ac3a48bf37e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:00.910741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:00.940053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:00.942177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:00.942451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:00.942719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:00.954079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:00.955700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:00.970791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:00.972277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:00.973235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:00.973235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:00.973235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:00.973235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:00.977020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 369/717] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:00.978919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:01.104031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63da06a-da39-45f1-9269-69a8fab89c4e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:01.146208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:01.146834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:01.147108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:01.147373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:01.148062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:01.148362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:01.149745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0e30-e95c-49b3-8953-b6b1f7ac8c3b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:01.167594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 349/718] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:01.176422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:01.338643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2ca60-e2a2-4e2c-9a9d-ab7660134fdd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:01.382058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:01.382617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:01.382895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:01.383164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:01.383872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:01.385370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1582-5041-486b-8edc-42c2d1199933 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:01.421934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 370/719] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:59:01 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:02.029593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55169-c7e0-4eb6-aa08-4131326991d0 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.030107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55169-c7e0-4eb6-aa08-4131326991d0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.030107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55169-c7e0-4eb6-aa08-4131326991d0 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.031715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 350/720] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:02.038006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4791b0-815a-4a15-82b3-870893dacde1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.038292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4791b0-815a-4a15-82b3-870893dacde1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.038569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4791b0-815a-4a15-82b3-870893dacde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.058677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4a4791b0-815a-4a15-82b3-870893dacde1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:02.059863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4a4791b0-815a-4a15-82b3-870893dacde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:02.072117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:02.147711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 371/721] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:59:02.186091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55169-c7e0-4eb6-aa08-4131326991d0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:02.227619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:02.336082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55169-c7e0-4eb6-aa08-4131326991d0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:02.387540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:02.388200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.388537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.388869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.389742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:02.391103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb73e51-4ca5-478f-bac7-ee5946220c74 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:02.416806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 351/722] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:02 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:02.536008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66815a-be7c-4afb-9bbf-aacbc5bdf391 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.536008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66815a-be7c-4afb-9bbf-aacbc5bdf391 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.536008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66815a-be7c-4afb-9bbf-aacbc5bdf391 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.536008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 372/723] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:02.541566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.541963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.542320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.571229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:02.572458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:02.680830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 352/724] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:59:02.703633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66815a-be7c-4afb-9bbf-aacbc5bdf391 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:02.837323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66815a-be7c-4afb-9bbf-aacbc5bdf391 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:02.880707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:02.881348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.881625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.881889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.897702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a6e2598e-35c2-4cb1-a9ae-646931a985f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:02.902525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:02.903445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:02.904291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 373/725] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:02.909738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:02.931128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:02.995316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e6b4-3dc0-48e6-8330-e68e105a0fa4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:02.995666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e6b4-3dc0-48e6-8330-e68e105a0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:02.995867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e6b4-3dc0-48e6-8330-e68e105a0fa4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:02.997874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 374/726] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:03.004506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.004808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.005080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.041582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.044448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:03.045622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:03.063463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb99a21-b453-4bd8-a97c-c40cfc685b33 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.107037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.107760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.108108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.108455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.109284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:03.109660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.111110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.120415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 353/727] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:03.125444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.179916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 375/728] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:59:03.200219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.203416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.235975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc7e1-3fd3-4842-ae62-096b2c116dfd None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.284918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.285580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.285853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.286117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.310222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.312798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:03.337308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:03.338267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:03.339152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:03.339152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:03.339152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:03.339152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:03.345043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 354/729] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:03.351275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.403543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cc28b-1f45-42f6-8fb6-5ae3561fc356 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.455230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.456893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.457384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.458122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.459012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.460781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c364-7464-422a-9086-3c946b16306e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.464557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.480462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 376/730] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:03 2022] POST /identity/v3/services => generated 240 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:03.490097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65da3-a2d5-4955-a206-d22f2abc65bb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.490712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65da3-a2d5-4955-a206-d22f2abc65bb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.491233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b65da3-a2d5-4955-a206-d22f2abc65bb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.493452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 377/731] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:03.495629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab02e-acfa-447b-ace3-14871411335e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.499045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.499670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.500189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.533091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.536414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:03.541001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:03.544182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.544943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.545266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.545538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.546283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:03.546527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.548035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.561938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 355/732] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:03.567740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.683300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 378/733] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:03.705430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1c6a-ab0a-4bcc-8d39-c142ccff81a0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.707724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.742886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.743686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.744061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.744514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.754717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.756724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:03.773180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:03.774208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:03.775168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 356/734] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:03.783128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.832018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714dac1-a7c1-4c83-b0a9-cfd6a43d1704 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.834964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.863574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:03.878773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.879723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.880022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.881401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.895946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:03.899397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29776efb-a7e1-4220-b2b0-97800d8c74b4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:03.901477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:03.902430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:03.903283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:03.903988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 379/735] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:03.910852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:03.952497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:03.953166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:03.953449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:03.953722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:03.954534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:03.955506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:03.957394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:03.983442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 357/736] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:03.990727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.079525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37decf86-2fcf-4310-9d8a-d6f507208acd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.115561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.122424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5936-3e93-445b-b236-d1381e339a71 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.168147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.169061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.169413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.169761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.182884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.184550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.190857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.191546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.191824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.192093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.192848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:04.193151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.194620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:04.201976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:04.204018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:04.206904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:04.206904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:04.206904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:04.206904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:04.212664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 358/737] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:04.212664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.222327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 380/738] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:04.233752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.313124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.351600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd916f5-1e98-4b72-940c-b91a85c164b4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.373581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac47b23-cb03-4b6b-9d5f-8d7928eddffa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.389294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.389923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.390213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.390652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.391490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:04.391890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.393346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527217b8-1ed2-4690-b8be-966b6a0a5e21 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.416696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 359/739] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:04.418919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a124ba-4610-4ee1-bbe8-29bc45f4cab7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.419402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a124ba-4610-4ee1-bbe8-29bc45f4cab7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.419850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a124ba-4610-4ee1-bbe8-29bc45f4cab7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.423217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 360/740] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:04.425032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a124ba-4610-4ee1-bbe8-29bc45f4cab7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.431088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.431746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.432027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.432299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.445121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.446574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.447739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3c3cfd28-92d6-4593-a70c-99c9569a24d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:04.467428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:04.469342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:04.471946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:04.471946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:04.471946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:04.471946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:04.473573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 381/741] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:04.474781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56713-424b-45a6-934f-970b544da48f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.475071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56713-424b-45a6-934f-970b544da48f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.475344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56713-424b-45a6-934f-970b544da48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.495725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-eba56713-424b-45a6-934f-970b544da48f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:04.497117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eba56713-424b-45a6-934f-970b544da48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:04.604360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a124ba-4610-4ee1-bbe8-29bc45f4cab7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.609984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 382/742] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:04.611351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56713-424b-45a6-934f-970b544da48f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.644040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.666426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.667252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.667431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.667602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.678830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.681045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:04.693328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:04.694444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:04.695457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:04.699313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 361/743] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:04.700165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.745589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56713-424b-45a6-934f-970b544da48f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.779188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.798343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.800382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.801163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.801669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.802938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:04.803837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:04.805446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:04.819479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4f14f-1f90-460c-91af-2d0c9f896184 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.823355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 383/744] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:04.824500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.859750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:04.860398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:04.860686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:04.860955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:04.872740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:04.878706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:04.879688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:04.880517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 362/745] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:04.881251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:04.958976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:04.978485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b79021-3824-459b-a4ef-bda57a8bdeea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:04.997225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f432bb3-8c26-47c9-b2c5-1edd242feb73 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.026655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.028002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.028511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.029753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.030084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.032489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:05.033351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.036121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.039853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.040380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.040665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.040971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.053240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 384/746] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:05.054481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.169336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.170802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.179125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62fd9-1bd9-4120-a8ac-f28f653992e1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-89ae900e-bfee-41c8-b185-6694e70f5b21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:05.183257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:05.184188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:05.185170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:05.189254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 363/747] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:05.191169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaf1b-a45e-4db8-9356-997dde816c91 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.191548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaf1b-a45e-4db8-9356-997dde816c91 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.191820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaf1b-a45e-4db8-9356-997dde816c91 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.197616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 364/748] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:05.197616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eaf1b-a45e-4db8-9356-997dde816c91 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.224719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.225337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.225621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.225890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.226599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:05.226896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.228254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.236406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 385/749] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:05.239266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.255887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.327560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747eaf1b-a45e-4db8-9356-997dde816c91 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.366484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876b8b-98b0-4a8b-9f3b-b3d32aeb7242 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.371459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.372277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.372555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.372855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.374931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=b65b1e894e3d4d2eb08b7cddfeff1822, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.376522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ca870-f08c-4bad-a5a2-965029a50766 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.400242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 365/750] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:05 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:59:05.400242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.400242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.400242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.414652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:05.415986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:05.419680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.420591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.421093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.421493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.422565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:05.422900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.424431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.453596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 386/751] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:05.454333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.472843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.503166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 366/752] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:05.504062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.571236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.615208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0b28e-3e69-4eb8-8f85-1afa69c6593d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.630161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97778ac-e4b6-4176-8f15-c7b0dbc68772 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.655776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.656753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.657254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.657536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.670922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.672466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.679554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.680500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.681014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.682028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:05.691845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:05.692811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:05.693687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:05.693687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:05.693687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:05.693687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:05.693687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 387/753] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:05.694398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.749638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.782650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.784991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.814146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcb16e-204a-4a37-9d5d-70c42ccdfc38 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:05.835499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:05.854440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:05.855445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:05.855711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:05.855979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:05.856602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:05.858058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:05.871641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:05.872879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:05.873868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 388/754] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:05.874903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.922112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 367/755] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:05.923071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:05.989585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01f29-6b2e-4c83-b02d-11bd9c3bb764 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.025043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.027007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.027843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.028290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.028671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075eb2-3f73-4922-b376-e0b774c8f51a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.028814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.029619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.029923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.031437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.048690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 389/756] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.048690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.072578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.073318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.073687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.074032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.074783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.075154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.076591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c15d3-dfd5-4c59-9bd8-95709f634b09 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.081840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 368/757] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:59:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.083343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f44b-1d16-4667-bb39-ae7697aed883 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.083626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f44b-1d16-4667-bb39-ae7697aed883 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.083893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f44b-1d16-4667-bb39-ae7697aed883 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.085276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 369/758] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:06.089874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f44b-1d16-4667-bb39-ae7697aed883 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.105752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.163396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7392f7-9adf-4ed9-85a1-2daf358a8ba7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.202689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.203316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.203587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.203851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.204730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f44b-1d16-4667-bb39-ae7697aed883 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.219611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.221335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:06.237319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:06.239002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 390/759] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:06.240273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.249128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.249778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.250048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.250323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.260060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.262275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4b1d78eb-3514-46af-877a-c0eef6c2400e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:06.278117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:06.279309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:06.280491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:06.285113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 370/760] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:06.286639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.286970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.287246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.295530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.311852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:06.313093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:06.361056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.369229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c3aa9-a7f2-483c-ad7a-c18a849cf147 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.406196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 371/761] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:06.407781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.433737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.435819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.436337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.436834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.437754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.438258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.440501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.448349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 391/762] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.449532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.547455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379555bb-5885-4f7e-bb20-a9d16580a47e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.581148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4479a5-df54-4fb2-ac60-c9fd5b4e7761 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.585694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.592105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.592767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.593044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.594643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.595436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.595745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.597806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.616743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 372/763] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.616743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.627901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.628526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.628847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.629116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.629922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.630224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.631655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.665758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 392/764] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.665758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.685588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.750373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fb53-6293-4829-8db4-bca9c7e4da3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.784971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea643b-c32c-4e2a-bbd5-e110b8575ebf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.795546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.796201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.796486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.796818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] PATH_INFO: `/v3/services/network` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.797451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.798827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:06.809999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:06.811230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:06.812062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 373/765] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:06.813466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.836277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.836988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.837297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.837466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.838212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] RBAC: Adding query filter params (interface=public, service_id=1461a06cb6b848a58377ef1d159c4eae, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:06.838525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.839878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:06.849758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 393/766] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/endpoints?service_id=1461a06cb6b848a58377ef1d159c4eae&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:06.850451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:06.883781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.935781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcaf46-aea7-46d9-a785-186221c94701 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.953784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:06.977833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bb5c8-371b-4f26-b053-ed2c98b66be1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:06.978778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:06.979786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:06.980282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:06.980777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:06.989417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:06.990893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:07.004351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:07.005348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:07.006303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 374/767] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:07.006804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.030711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.031339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.031616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.031885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.124615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.126248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.137024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c299a0-29b5-48b2-baec-756d1e99973c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.156903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.182084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.182718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.182982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.183250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.183933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] RBAC: Adding query filter params (name=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.184227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.185629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.191201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 375/768] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.192051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.228482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.250254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 394/769] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:07.251316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.313040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4034c-42ca-4c66-8f2a-8426b8950867 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.352031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.352668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.352958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.353231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.353876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.355234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.359128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858ec9-2c4d-4b83-a014-0b261b8d909d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.360497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 376/770] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.361301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.407471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.409053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.409561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.410011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.410962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.411481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.413292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.419070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.433177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 395/771] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.434560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.483136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.486788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25800-5a6f-46ac-811e-1db6d0a0eb46 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.526682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.527367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.527667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.528030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.528767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] RBAC: Adding query filter params (type=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.529072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.530468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.541790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 377/772] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.541790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.563817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662de-89ad-4081-9699-c83f2dfe01d8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.607238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.608674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.608825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.609163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.621098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.622123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:07.642449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:07.644623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 396/773] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:07.645557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.662284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081328-76a3-40b6-850b-d4c573cb5c04 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.673868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.707264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.708169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.708461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.708750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.709677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=cc4333399bc542e39a9f4d794dcccdf1) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.709856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.711272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a450-c770-43af-a286-2bd5db525220 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.717169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 378/774] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/role_assignments?user.id=cc4333399bc542e39a9f4d794dcccdf1&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.722542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791132a8-3ab3-4c3a-bac8-96a726b0f13a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.723409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791132a8-3ab3-4c3a-bac8-96a726b0f13a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.723889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791132a8-3ab3-4c3a-bac8-96a726b0f13a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.730344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 379/775] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:07.730344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791132a8-3ab3-4c3a-bac8-96a726b0f13a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.762861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.775209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40f37c-c408-43ba-b4d3-42a186125ca5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.826717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.828277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.828799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.829717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.831215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] RBAC: Adding query filter params (interface=public, service_id=f826247c20d0489abf1553fefb6497e3, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.832018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.834794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84d95-e065-4c2e-aedb-ef532aac62ff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.843596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 397/776] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/endpoints?service_id=f826247c20d0489abf1553fefb6497e3&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.846786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.847258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.847719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.860667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791132a8-3ab3-4c3a-bac8-96a726b0f13a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:07.873848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:07.875221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:07.905498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:07.906121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:07.906393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:07.906678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:07.907351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:07.907649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:07.912692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:07.930387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 380/777] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:07.931406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:07.969321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:07.969899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 398/778] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:07.980668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.076706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1d3c-26a7-41cf-aeed-c72dd055fb02 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.108884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:08.115813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.116448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.116716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e6c7-a843-4706-b085-b8134a8625d7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.116845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.117000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.117683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.119054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.132681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 381/779] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:08.132681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.188366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.189387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.190546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.191045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.206596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.208355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:08.229497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:08.230459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:08.231437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 399/780] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:08.237520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.245565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd434e2-ea0a-4132-aaeb-e641a9b19545 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.273025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:08.282023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.282677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.282960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.283232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.296271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:08.301342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:08.302265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:08.303116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:08.307419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 382/781] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:08.308627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.359855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8567654-64f8-4587-9b8c-acd37127a504 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.426529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.427152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.427429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.427701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.428451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:08.428820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.430246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.431208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aadc26-6316-47bd-b0de-ef8015854f45 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.443956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 400/782] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:08.449344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.463767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:08.473076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.473979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.474453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.474867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.475756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:08.476216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.477868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.491617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 383/783] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:08.493374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.515114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:08.581972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793b14-d413-414b-9649-e3fda7f2aa7f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.634131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e653-f324-4a7b-95f4-fb6faf8035e1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.641635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.642262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.642539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.643620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.644201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=ad22ebee6031482a866b0276d8506f46) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:08.644505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.645961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.655587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 401/784] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/role_assignments?user.id=ad22ebee6031482a866b0276d8506f46&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:08.681458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.682229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.682579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.682925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.695992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.697555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:08.722051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:08.723021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:08.723904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:08.723904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:08.723904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:08.723904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:08.723904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 384/785] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:08.729413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:08.847649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:08.880166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d6d7-c184-4b1e-9da0-1668124bd62f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:08.926480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:08.927103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:08.927382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:08.927651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:08.928333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:08.928648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:08.930006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:08.952205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 402/786] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:08.958740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:09.049368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:09.097147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd3a9d-5734-46a9-b7e4-e09bf69dd881 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:09.136215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:09.136888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.137171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.137439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:09.146464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:09.147898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:09.159678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:09.160621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:09.161603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:09.164741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 385/787] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:59:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:09.166829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:09.306323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ccbe-2343-4d82-ba05-000292728614 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:09.346488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:09.353341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:09.354328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.354616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.354962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:09.355762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:09.356119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:09.357568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:09.388387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 403/788] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:59:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:09.397068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:09.528528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62135-5143-4a2d-ab38-5d3ab4cae51d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:09.556997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:09.567258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:09.567887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.568165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.568434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:09.664141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:09.666150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29972-18fb-4850-965d-071bb84c0d3a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:09.803692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 386/789] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:09.809188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:09.857724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefeed2-ffc3-45ce-9e65-4bccd34ee3bf None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.858048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefeed2-ffc3-45ce-9e65-4bccd34ee3bf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.858277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefeed2-ffc3-45ce-9e65-4bccd34ee3bf None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:09.859852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 387/790] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:09.866199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.866486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.866748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:09.885247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:09.886436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:09.913990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:09.946253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578eaa5-7602-49fb-a5e8-afc276c8c7fe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:09.990586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:09.991230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:09.991508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:09.991775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.015792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.018999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.028728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 388/791] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:10.039736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:10.040623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:10.041531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:10.041531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:10.041531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:10.041531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:10.041531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 404/792] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:10.046600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.066048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.131439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.248484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730403-8333-4668-b125-7db83122cb85 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.251686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f605a-7806-42b3-86f1-36f78a6fc940 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.312146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.312810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.313092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.313362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.313986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.315373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.316724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.317294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.317569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.317836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.318529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:10.318830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.320182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f200f-e48c-42d9-bf4e-6673e04687ee None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c2838047-d464-45d9-81b9-829581f10cc7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:10.329951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:10.331741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:59:10.332615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:10.333702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 389/793] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:10.334824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80de94-7775-4e91-89ce-bc0bcbd35471 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.335105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80de94-7775-4e91-89ce-bc0bcbd35471 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.335379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80de94-7775-4e91-89ce-bc0bcbd35471 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.336609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 405/794] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:10.340588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 390/795] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:10.340588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80de94-7775-4e91-89ce-bc0bcbd35471 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.342344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.342904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.343233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.364190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.366914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:10.368926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:10.460746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 406/796] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:10.461668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.494747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80de94-7775-4e91-89ce-bc0bcbd35471 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.531897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.539377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.540033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.540312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.540654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.548466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.550915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:10.565687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:10.566881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:10.568000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:10.571861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 391/797] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:10.572710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.631218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1349a-5ab2-4596-bb71-34515096b1ff None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.681895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.682551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.682829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.683100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.683819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.685594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:10.685917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.687577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.695509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 407/798] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:10.696720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.710600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db69b-3ab6-44e0-972f-482a5c5f8537 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.760112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.761551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.762042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.762492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.777110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:10.784412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:10.785625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 392/799] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:10.792235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.817321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.821883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743de56e-1cb8-4fc8-8286-c4068841305b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.858596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.859207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.859487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.859757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.860494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:10.860835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.862284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ce8b-e4cb-48e5-b8ad-36f906b5729d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.874151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 408/800] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:10.875441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbda91-4f5c-4790-b47d-76004922fc9d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.875722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbda91-4f5c-4790-b47d-76004922fc9d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.875991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbda91-4f5c-4790-b47d-76004922fc9d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.878379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 409/801] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:10.878689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbda91-4f5c-4790-b47d-76004922fc9d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.909740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978264e-e662-4696-952a-1d7a31ffcf5e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:10.947227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:10.947851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:10.948133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:10.948408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:10.949113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:10.949425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:10.950794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:10.958886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 393/802] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:10.959948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:10.964436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:10.991226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbda91-4f5c-4790-b47d-76004922fc9d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.027268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.027893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.028184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.028450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.029207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:11.029515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.030897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264dcfd-1b3e-4b5a-853f-9e3e982ec3a1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.040178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 410/803] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:11.041462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.041801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.042081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.060129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:11.061363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:11.078522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5e521-c87d-4d33-acc6-38aea490e8d5 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.084725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.122883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.123810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.124412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.125435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.126883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:11.127479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.129117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.136040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 394/804] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:10 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:11.137205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.160683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 411/805] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:11.160683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.221215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.262821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2c39-04ee-477b-868b-2f71d78a405d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.276703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53612ff1-c1b9-4ec9-acff-f21b2518ec68 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.306715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.307348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.307623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.307891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.308604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.309996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817868-d5e0-44ee-867f-ff7286571b49 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.324765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.325303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.325580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.325856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.334329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 395/806] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:11.335648 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a485-546c-4437-bc68-cd4137e8db28 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.335941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a485-546c-4437-bc68-cd4137e8db28 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.336215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a485-546c-4437-bc68-cd4137e8db28 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.337829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 396/807] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:11.338587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a485-546c-4437-bc68-cd4137e8db28 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.341457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.344398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fd24f6ca-fa9e-40f4-8619-f6886224a5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:11.363432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:11.364442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 412/808] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:11.366192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.366535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.366535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.376395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.390907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:11.392277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:11.495892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a485-546c-4437-bc68-cd4137e8db28 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.511297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 413/809] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:11.512573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.541912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.567468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.568111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.568392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.568684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.569323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.570688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:11.587499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:11.588556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:11.589872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 397/810] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:11.590685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.641201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560f1d9-a0f1-4967-8bcd-2add84422487 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.679164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.679911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.680254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.680601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.681504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:11.681878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.683470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.695631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.699265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 414/811] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:11.700248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.726576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05527-99e7-4b41-8ad5-0a0ef1a048b1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.763253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.764241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.764730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.765228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.776453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:11.782385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:11.783958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:11.784843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:11.789406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 398/812] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:11.790628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.811979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e0d6b-0588-4bfc-85d8-1ec9ba11c327 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.839942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.850266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.850881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.851167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.851446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.852124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:11.852414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.854176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.864562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 415/813] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:11.865761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.903861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f082a7-1355-403e-8194-3d053faed206 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:11.928234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:11.942075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:11.943026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:11.943538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:11.944000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:11.952477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:11.954381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:11.967051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:11.968214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:11.969405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:11.971290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 399/814] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:11.972223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:11.982711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e253-aae3-44c5-90de-96b92c0c9d03 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.031611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.032812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.034257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.034687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.035825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:12.036534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.038776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.051057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 416/815] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:12.052169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.088822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab50d-a95a-4000-b33b-2158247e9241 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.092719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.131683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.132709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.133209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.133679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.134460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] RBAC: Adding query filter params (type=network) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:12.134857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.136321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.146592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 400/816] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:12.146592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.203229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24150b88-a914-4a73-837e-f0df8d558a01 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.220103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.243819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.245290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.245798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.246660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.247950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:12.248456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.251013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.274981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 417/817] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:12.276232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.281554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c29e6-eb02-4e77-800f-22e8b5d2537a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.324250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.324921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.325204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.325484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.339649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.341716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:12.360862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:12.362460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:12.363338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:12.363338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:12.363338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:12.363338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:12.364718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 401/818] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:12.365794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.396085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.402016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065122-5c46-49ed-a245-b1e478f83e93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.447510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.448133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.448414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.448712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.449548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.451051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.478058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 418/819] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:12.479283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.488747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a0b0a-1cbe-41a4-a15b-d4b87d326e49 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.519341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.545618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.546260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.546547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.546789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.559315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.560824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:12.576879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:12.577832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:12.578729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:12.578729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:12.578729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:12.578729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:12.578729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 402/820] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:12.589749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.641842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530648c5-2dba-4a3d-a102-82809245f024 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.693865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.703463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.704105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.704389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.704660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.705952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:12.706262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.708498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.724914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 419/821] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:12.730698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.749442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73d813-5b93-4a2f-9e64-2542da273f5d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.803740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.804627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.804939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.805678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.806639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:12.806948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.809032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.826044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 403/822] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:12.832809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.847941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.859366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e3b6-486a-4d67-89b4-38be902ece60 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.906367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.907329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.907875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.908158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:12.918757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:12.920475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:12.938155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:12.940361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:12.942631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 420/823] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:12.946036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:12.957689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce2d5f-60ee-46ae-a9ea-c6eec3c664f7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:12.987986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:12.997678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:12.998463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:12.998743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:12.999007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.006603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.008201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:13.020822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:13.022783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:13.024925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 404/824] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:13.029710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.073143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12f7c3-69f9-4760-bb31-0146d3884026 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.122683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.123879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.124911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.125385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.126613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:13.127451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.129806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.153808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 421/825] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:13.159843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.173072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.175911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383aca5-e4b3-49cb-bf03-b157005ff6e2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.214710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.215850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.216322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.216868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.217876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:13.218388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.220042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.234824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 405/826] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:13.242665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.280522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254eb4f-bf76-45f0-a86f-53ea8ccbcc3e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.316127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.324100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.324770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.325047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.325320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.339077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.341076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:13.360589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:13.362134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:13.363028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:13.363028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:13.363028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:13.363028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:13.364713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 422/827] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:13.369585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.385112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4419-d542-446d-a54c-a453bb7af3d3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.423081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.423663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.424497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.424766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/cc4333399bc542e39a9f4d794dcccdf1/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.426701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=cc4333399bc542e39a9f4d794dcccdf1, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.428123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae4cff-87bc-4b75-885c-9cc07df043ba None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.436515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.443169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 406/828] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:13 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/cc4333399bc542e39a9f4d794dcccdf1/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:59:13.451173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccab-e704-4531-b291-ec1d13891408 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.451893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccab-e704-4531-b291-ec1d13891408 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.452371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccab-e704-4531-b291-ec1d13891408 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.458635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 407/829] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:13.460342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.460622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.460925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.488074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:13.490229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:13.494190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f913a1-3b18-43a6-8533-6cda08da701d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.545206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.546188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.546676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.547121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.548010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:13.548488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.550234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.569444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 423/830] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:13.577153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.592672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 408/831] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:13.619337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.673884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.702026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40858d-d166-4cf4-8635-123700bd5107 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.724880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.739873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920bf9-dc35-4a94-b3f7-cbc4c4b468b0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.741460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.742104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.742388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.742666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.749919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.751362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f9328b14-7580-4e26-8d81-2032539e6836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:13.763661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:13.764566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 424/832] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc6cb-78be-4a60-a17f-e068212d448b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.771431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc6cb-78be-4a60-a17f-e068212d448b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.772031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc6cb-78be-4a60-a17f-e068212d448b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.773067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 425/833] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:13.773899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc6cb-78be-4a60-a17f-e068212d448b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.780017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.780690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.780975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.781247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.781877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.784250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4f154bee-84ca-4770-8fa2-c5efefbe37b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:13.794168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:13.795107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:13.802360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 409/834] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:13.803621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.803621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.803621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.824485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:13.825725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:13.904665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 410/835] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:13.904665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:13.905762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc6cb-78be-4a60-a17f-e068212d448b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:13.940696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:13.954341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:13.955736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:13.956019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:13.956287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:13.957067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:13.957377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:13.959130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:13.972891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 426/836] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:13.974026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:14.017151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:14.030686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4b66-32a8-4699-a08b-e243abdb3c80 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.068003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.068753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.069033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.069303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.070090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:14.070507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.071868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.075996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c35cd-1418-4e7b-91bf-c4e54fb15306 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.082287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 411/837] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:14.083922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:14.117995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.118640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.118920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.119192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.119821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.121220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:14.130138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:14.131347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:14.132226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 427/838] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:14.133043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:14.199539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:14.207807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a4da-2fb5-4557-8f71-434fe569b556 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.243016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9307a-cb3d-4ef1-9afa-f889b1c0c8a6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.245485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:14.249730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.250414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.250692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.251382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/ad22ebee6031482a866b0276d8506f46/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.269078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=ad22ebee6031482a866b0276d8506f46, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.270527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.281464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.282083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.282362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.282631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.283850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:14.292933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 412/839] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:14 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/ad22ebee6031482a866b0276d8506f46/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:59:14.293170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.293268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:14.293362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.305399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 428/840] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:14.417379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975f4f-8d60-4ae0-b14e-a5e9f2130890 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.460622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.461312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.461683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.462016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.462847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:14.463222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.464722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa703d-50e9-4a53-baa1-e786afbcf683 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.470367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 413/841] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:14.477262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:14.594545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3a32-5dbe-490b-9822-3cceafd03c93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:14.632576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:14.633488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:14.633915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:14.634338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:14.635152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:14.635705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:14.637246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336d28d-d36c-47bf-b592-5f95e9873e6b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:14.642445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 429/842] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:15.506353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb179b-0430-4648-82f8-855b3ee0561d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:15.506878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb179b-0430-4648-82f8-855b3ee0561d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:15.506878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb179b-0430-4648-82f8-855b3ee0561d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:15.508453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 414/843] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:15.514310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:15.514747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:15.514846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:15.534002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:15.535214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:15.561305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:15.604631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 430/844] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:15.628617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb179b-0430-4648-82f8-855b3ee0561d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:15.641047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:15.738597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb179b-0430-4648-82f8-855b3ee0561d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:15.774809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:15.775462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:15.775740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:15.776013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:15.788893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:15.798323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:15.800040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:15.800950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 415/845] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:15.806348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:15.914120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3471f1-114c-405e-bcb6-0383936980e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:15.950803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:15.951419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:15.951696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:15.951965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:15.952697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:15.953005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:15.954367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:15.966232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 431/846] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:15.971794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.045809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.078672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764ce3-5372-491a-9189-08e303100e9a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.122606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.123309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.123593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.123867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.134746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:16.136202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:16.151690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:16.152616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:16.153538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:16.153538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:16.153538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:16.153538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:16.153538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 416/847] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:16.159336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.189008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.264480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e2a5-7db5-4b88-81b3-2ef2be67e7cd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.301043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.301989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.302464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.302927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.303819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:16.304313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:16.305931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c64e7-d7a0-4486-8444-9c7c1dfe93ee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:16.322884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 432/848] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:16.328463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.432440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6021-fd03-4ae6-829e-df66d08f4d0a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.456483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.469243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.469892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.470169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.470444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.479185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:16.480654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:16.483776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc51b6-41f9-488f-889b-f0a70418993c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.484065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc51b6-41f9-488f-889b-f0a70418993c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.484344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc51b6-41f9-488f-889b-f0a70418993c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.486007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 433/849] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:16.491878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578d96-cecb-4d66-81a5-472f7d3476b9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.492161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578d96-cecb-4d66-81a5-472f7d3476b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.492437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578d96-cecb-4d66-81a5-472f7d3476b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:16.493706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:16.494616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:16.495567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 417/850] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:16.500803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.511159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b8578d96-cecb-4d66-81a5-472f7d3476b9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:16.512346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b8578d96-cecb-4d66-81a5-472f7d3476b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:16.585608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 434/851] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:16.595306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d44ec-705f-4259-a0e9-c27a79e6107f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.596351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d44ec-705f-4259-a0e9-c27a79e6107f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.596883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d44ec-705f-4259-a0e9-c27a79e6107f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.602765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 435/852] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:16 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:16.604806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.605299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.605792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.627184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:16.628480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:16.638890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.642159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a50c8-fd43-42b1-bc78-425862b5efe7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.677512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.678134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.678409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.678734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.679698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:16.680024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:16.681483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:16.708565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 418/853] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jul 28 05:59:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:16.708565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.722305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 436/854] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:16.733288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.760360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.831198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35c3c-5163-45be-aee5-a3349f77de6b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.848818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642d7f9-72ca-4c64-b902-493416db889d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:16.866796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.867689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.868738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.868738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.880349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:16.885652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:16.886613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:59:16.887504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:16.888312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:16.888312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:16.888522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:16.888784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:16.892090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 419/855] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 05:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:16.893564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:16.905097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:16.963550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:16.965143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a6e72-f33f-4b50-8fdf-9707a9194271 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.004198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.007988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100b27-c6b2-49f9-82a4-cd477b8dd36a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.054763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.055722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.056149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.056555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.057744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.059932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963276b-4bc9-4e23-b0dd-d4e566b73977 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.081176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 420/856] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:16 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:17.083500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7568ca-02a7-4c7a-aac8-125acfd9abbc None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.083975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7568ca-02a7-4c7a-aac8-125acfd9abbc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.084444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7568ca-02a7-4c7a-aac8-125acfd9abbc None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.086601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 421/857] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:17.087770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7568ca-02a7-4c7a-aac8-125acfd9abbc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.113850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 437/858] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:17.113850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.113850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.113850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.134814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:17.136726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:17.201416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.241618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7568ca-02a7-4c7a-aac8-125acfd9abbc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.247280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 438/859] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:17 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:17.247280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.286105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.286746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.287026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.287296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.288020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:17.288334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.289769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.302941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 422/860] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:17.303715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.325387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.384376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c933e-4da2-4a0a-8ee9-1b7957876550 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.424177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.424857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.425140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.425411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.425814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f9c4-a85c-4612-9b05-a7306457a8ea None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.435929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.437414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:17.454041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:17.455591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 439/861] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:17.456727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.472923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.473491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.473769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.474038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.474727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.476083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.484001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.493434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 423/862] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:17 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:17.494478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.597059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.609101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbab89-6131-4f9f-a63f-31f37d2607f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.635562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83429a5-ab6c-431b-a46c-b6e39c8fcb61 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.659495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.660139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.660413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.660708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.675312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.676782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.680136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.681360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.681644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.681917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.682608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:17.682911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.684259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:17.695682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:17.696602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:17.697805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:17.697805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:17.697805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:17.697805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:17.698436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 440/863] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:17.700583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 424/864] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:17.702578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.710226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.807533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.836797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372263c-6d27-4720-8fd7-7821ccb6828e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.849705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eec5d-d89c-4f77-90cd-eead5393e36b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:17.885187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.886222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.886465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:17.886944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.887135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:17.887371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:17.887641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.888001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:17.888892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:17.889393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.890042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:17.893101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.896434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:17.898000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:17.909403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 441/865] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:17.914628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:17.915681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:17.916802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:17.918232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:17.919897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 425/866] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:17.929582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.044845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d859dbf-1fca-470a-a534-1492ad7dc347 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.064050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601776b9-d688-45c8-a4c1-cf9f1b6c0d3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.082608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.083890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.084427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.084928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.087512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:18.095065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.096917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.110673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.110779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.111029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.111373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.112138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:18.112445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:18.113005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:18.113929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:18.114862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:18.115399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.122045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 442/867] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:18.123201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.129080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 426/868] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:18.138015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.218638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:18.240254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92209da-1c0f-4b40-8732-41b506dbaecd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.278227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.279326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.279853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.280369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.281399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:18.281904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.282310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba26e94-4945-4211-8eda-52d5deecbca3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.283804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.306787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 443/869] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:18.308009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.326165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.327085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.327376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.327655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.328455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=cc4333399bc542e39a9f4d794dcccdf1) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:18.328801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.331560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.340715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 427/870] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:18 2022] GET /identity/v3/role_assignments?user.id=cc4333399bc542e39a9f4d794dcccdf1&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:18.384476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:18.438164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efa74-2547-4556-8a92-26251a87f5f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.480663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.480663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.480663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.480663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.555425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.556904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.614588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:18.667766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 444/871] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:18.673327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.782558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736558c3-dcee-43bb-ae30-042288b275e9 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:18.800422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:18.819304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:18.820177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:18.820603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:18.821146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:18.833206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:18.834928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:18.849619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:18.850705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:18.851787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:18.851787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:18.851787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:18.851787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:18.853688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 428/872] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:18.860785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:18.967164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f09c-088b-4706-b787-dd1357cf792f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.004496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.005413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.005838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.006254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.007077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:19.007521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.009045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6df2b1-165f-4504-889a-b5617a749970 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.022190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 445/873] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:19.029767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdcc8-8061-4228-a435-64265d7492bb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.179088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.179786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.180070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.180344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.187611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.189214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.190436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257831-31a2-4577-ae7c-826e84c6e883 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.190720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257831-31a2-4577-ae7c-826e84c6e883 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.190991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257831-31a2-4577-ae7c-826e84c6e883 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.192590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 446/874] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:19.197611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.197892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.198160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:19.201425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:19.202297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:19.203444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 429/875] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:19.209482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.221977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:19.223940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:19.233658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.261790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.313197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 447/876] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:19.323153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932bbb0-eb8f-49bb-bf2a-7d339c1e4a71 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.332606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.367532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.368080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.368362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.368657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.370496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:19.370822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.372257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.388778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 430/877] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:19.394987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.453902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5931-689d-4bcd-b829-fd6cb44716c5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.500153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.501105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.501523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.502113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.502898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.504544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.509927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:19.515383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:19.516491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:19.518260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:19.528234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 448/878] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:19.529338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.538910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c710-ecee-419b-a1f4-d52c62320799 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.540033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.584932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.586146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.586609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.587061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.588719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=ad22ebee6031482a866b0276d8506f46) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:19.589233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.591357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b371ccb-8c6b-456a-b6f6-bb49389a110e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.604983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 431/879] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/role_assignments?user.id=ad22ebee6031482a866b0276d8506f46&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:19.651128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb236b-9c23-494b-a37c-9e1f3538c2aa None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.651308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb236b-9c23-494b-a37c-9e1f3538c2aa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.651592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb236b-9c23-494b-a37c-9e1f3538c2aa None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.653012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 432/880] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:19.659805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.660092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.660365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.665245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d00b-3481-49de-8d46-8d7feb9b5258 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.681318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:19.682418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:19.717001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.717642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.717919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.718186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.719153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:19.719535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.722586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.732689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 449/881] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:19.735049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.784770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 433/882] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:19.806445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.825604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.871254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68302ee6-4aed-499c-b1d9-31ef76366e40 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.915911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:19.921807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.922860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.923236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.923657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.925187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:19.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.927599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:19.933944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 450/883] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:19.940411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:19.942601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7945407-255c-44ed-a260-6913a791ce3c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:19.991606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:19.992528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:19.992828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:19.993100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:19.993778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:19.996102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:20.008691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:20.009744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.010611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 434/884] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:20.018266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.079167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2089db5-0cbb-4ffa-af58-e080ef54f71e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.122853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.123473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.123751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.124018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.124792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] RBAC: Adding query filter params (interface=public, service_id=54c9a670cb6c4ed08707406668701939, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:20.125102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.126463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.128741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:20.133851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 451/885] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:19 2022] GET /identity/v3/endpoints?service_id=54c9a670cb6c4ed08707406668701939&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:20.140032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.145258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591c764-c88c-44a5-8590-08230c1fd7cb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.192765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.193797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.194296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.194795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.195728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:20.196236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.197960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.204167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 435/886] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:20.211140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.228940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:20.259225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13138-378e-4165-9c75-4adf11a90709 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.294931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.295548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.295824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.296091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.296808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.298158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.308727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 452/887] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:59:20.335564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c9a5-69b8-4992-b0c5-f48c47460ab1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.374568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.375203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.375478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.375746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.376435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:20.376766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.378904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.384917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 436/888] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:20.390795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.462839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:20.514455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb90d-2fb5-43c7-8c10-32fc1054ae79 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.553677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.554287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.554563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.554829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.555567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] RBAC: Adding query filter params (interface=public, service_id=3197341f45dd49fdb249ba59f7c1adfe, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:20.555871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.557316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04c60e-0d54-47a1-996d-475b7770128d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.562867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 453/889] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/endpoints?service_id=3197341f45dd49fdb249ba59f7c1adfe&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:20.568324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.649645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:20.669554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49504cd-265f-43a7-bab1-52029bbaa0e7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.670052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49504cd-265f-43a7-bab1-52029bbaa0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.670160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49504cd-265f-43a7-bab1-52029bbaa0e7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.672623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 454/890] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:20.674892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f46b6-d2b8-48bd-8e08-829090870589 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.677511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.677798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.678076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.696341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:20.697607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:20.718542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.719084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.719367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.720065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.721312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.723159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.732259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 437/891] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:59:20.788899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 455/892] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:20.808777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:20.925485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328e009-fc16-4f88-8d29-680fa1f66c98 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:20.967140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:20.968282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:20.968864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:20.969346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:20.970170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:20.973023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:20.982533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:20.983607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:20.984490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:20.987918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 438/893] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:20.993829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:21.053872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:21.101473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd220d-277d-4493-a9bb-378f71fbcc23 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:21.137378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:21.137999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:21.138280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:21.138549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:21.139229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:21.139536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:21.140928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae9a9-ed8c-4217-8b9e-f396131217ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:21.150880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 456/894] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:21.152274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:21.156979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:21.269550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f56451-2d0d-41df-8406-e4c7ff7f2705 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:21.305153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:21.305775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:21.306049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:21.306313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:21.306980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:21.307281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:21.308629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbd33e-f962-4f4b-82b7-211a13a57918 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:21.313540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 439/895] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:21.860696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9cc3-1669-4544-8237-f689bb993758 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:21.861810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9cc3-1669-4544-8237-f689bb993758 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:21.862147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9cc3-1669-4544-8237-f689bb993758 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:21.863995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 457/896] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:21.869676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:21.870589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:21.871081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:21.889812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:21.891349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:21.972986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:21.980018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 440/897] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:22.004066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9cc3-1669-4544-8237-f689bb993758 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.125579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9cc3-1669-4544-8237-f689bb993758 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.147759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:22.162011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.162742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.163020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.163286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.173180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:22.178744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:22.179680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:22.180571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 458/898] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:22.186066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.290323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbd613-a115-4819-aca9-52ccfce2e8f6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.325803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.326811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.327087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.327351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.328067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:22.328384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.329752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526198b2-9385-4ba6-a202-2833fde25508 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.338758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 441/899] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:22.344285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.446407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976d70-2022-4a3a-9c49-5ac4dbb44910 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.455771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb169a-dd43-4a25-8c73-e83e120e73ad None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.456092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb169a-dd43-4a25-8c73-e83e120e73ad None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.456327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb169a-dd43-4a25-8c73-e83e120e73ad None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.458383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 442/900] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:22.463523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.463806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.464085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.484452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:22.485604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.485747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:22.486280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.486560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.486825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.497361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.498812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:22.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:22.514982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:22.515873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:22.515873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:22.515873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:22.515873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:22.515873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 459/901] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:22.521999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.553055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:22.560881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:22.572993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 443/902] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:22.589864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.637372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b221b-ccc2-4fbf-8a7f-804aa5c8c945 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.673730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.674495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.674869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.675239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.676176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:22.676428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.677917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.694909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 460/903] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:22.695636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.708466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35489f55-7964-4480-9046-64cf75d5ccc8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.748122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.750017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.750778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.751294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.752228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.753973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:22.764852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:22.765864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:59:22.766732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:22.773004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 444/904] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:22.776800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.793210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:22.802796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbbd0-552e-4448-9089-ca6f9f0472db None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.839896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.840549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.840874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.841146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.842545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:22.849806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.851263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:22.866067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:22.867546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:22.868510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:22.872183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 461/905] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:22.873418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.902744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b269e98-8b58-42d2-8691-5761deed0c5a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:22.940550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:22.941577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:22.942073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:22.942569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:22.943458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:22.943974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:22.945598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:22.956486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 445/906] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:22.959048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:22.986766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f017-a0a4-4a50-996a-15b2a98cd88a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.029434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.030417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.030867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.031310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.032591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:23.033792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.036303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2306f-1b54-4ddb-a30a-b13fccd48ca8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.064941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 462/907] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:23.070033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346268b7-2459-481c-ac28-4d8edab1e0a2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.070033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346268b7-2459-481c-ac28-4d8edab1e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.070033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346268b7-2459-481c-ac28-4d8edab1e0a2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.071558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 463/908] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:23.072027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346268b7-2459-481c-ac28-4d8edab1e0a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.089712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.114503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a689-bd2e-42a4-a85b-e1b973fc2679 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.135573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.161288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.161977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.162252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.162517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.163186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:23.163485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.164926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379f4d-7a49-45f7-a5cb-afef655a5cd6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.174191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 446/909] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:23.175402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.175683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.175976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.199529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:23.200742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:23.219262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346268b7-2459-481c-ac28-4d8edab1e0a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.268506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.269225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.269498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.269772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.294936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 447/910] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:23.295671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.369866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.372085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.387400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.422771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7268-0128-41a7-a525-0d858cbe38ab None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.438217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.463169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.463798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.464072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.464338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.465061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.466418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d152e7-1b75-494a-85f0-cda07e39471d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.493231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 464/911] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:23.493513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 448/912] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:23.493513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3af85-8c1e-4215-a8cd-8fd0a9bd231f None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.493513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3af85-8c1e-4215-a8cd-8fd0a9bd231f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.493513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3af85-8c1e-4215-a8cd-8fd0a9bd231f None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.493513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 449/913] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:23.495370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3af85-8c1e-4215-a8cd-8fd0a9bd231f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.497640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.619287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4bd2-1616-4e2b-8e73-1d1ccea507b6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.629847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3af85-8c1e-4215-a8cd-8fd0a9bd231f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.631592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.658377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.659107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.659380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.659640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.660264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.661672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-841a17ec-343b-4a47-8e3f-629ccddc82dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:23.672211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:23.673267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:23.674708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 465/914] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:23.675516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.675516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.675516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.680237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.681522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.681522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.681522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.694000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.695411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:23.695526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.696586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:23.713555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:23.714482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:23.715357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:23.715357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:23.715357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:23.715357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:23.715357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 450/915] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:23.716090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.736058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.778596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 466/916] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:23.785542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.827197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737167-d090-42aa-980e-75bab91ec628 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.866795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.867530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.867809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.868078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.868795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:23.869100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.870462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.880509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 451/917] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:23.881487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.897945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d410742-f7a6-4925-849f-2b0dd7bf6d56 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:23.900201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:23.935542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:23.936308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:23.936584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:23.936876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:23.937559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:23.937855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:23.939824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:23.955201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 467/918] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:23.955201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:23.976501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:24.003062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef59b-385b-4d33-b63f-b86fc98589f6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.047168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.047709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.047985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.048264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.049587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.050990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.059912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499929a0-48e0-482a-befb-6ad702acaf5e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.068351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 452/919] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:23 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:24.069033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:24.129342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.131154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.131689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.132178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.133623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:24.134288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.136735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.150737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 468/920] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jul 28 05:59:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:24.151362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:24.193006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:24.211643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21d1c-78ea-4ef4-95bb-fff5b18ba636 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.256668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.257319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.257600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.257940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.265510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.266968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.271509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:24.282361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:24.283837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:24.285396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 453/921] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:24.291221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:24.306791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946a0ec-8581-4981-a831-ee5817b67d74 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.348162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.349115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.349574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.350041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.350982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.352542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.375771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 469/922] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:24.412227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6a01-27de-4514-9960-4235870e4ab7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.462939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.464099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.464730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.465213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.466196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:24.466831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.468820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42378f09-640d-4360-b92f-9dfd3ae1a2d0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.484352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 454/923] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:24.491679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:24.583933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:24.607693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa7e9d-d58f-41f3-b923-d9b93e2b9f83 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:24.644398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:24.645047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:24.645321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:24.645585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:24.646364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] RBAC: Adding query filter params (role.id=80f002492e8a4e2a8cbbb55e4f739a79, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=ad22ebee6031482a866b0276d8506f46) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:24.646667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:24.648085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fdcd-75c3-4e6e-82e3-e7d100828aa7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:24.654614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 470/924] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:24 2022] GET /identity/v3/role_assignments?user.id=ad22ebee6031482a866b0276d8506f46&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=80f002492e8a4e2a8cbbb55e4f739a79 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:25.614588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842357ba-edd2-4f39-a624-8847df3b1c81 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:25.615602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842357ba-edd2-4f39-a624-8847df3b1c81 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:25.616114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842357ba-edd2-4f39-a624-8847df3b1c81 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:25.618007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 455/925] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:25.623607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:25.624100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:25.624313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:25.643251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:25.644436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:25.720352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 471/926] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:25.743827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842357ba-edd2-4f39-a624-8847df3b1c81 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:25.818200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:25.869501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842357ba-edd2-4f39-a624-8847df3b1c81 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:25.907096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:25.908682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:25.909170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:25.909641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:25.910508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:25.912065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:25.921540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:25.922570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:25.923404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:25.926916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 456/927] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:25.932684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.021165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:26.040345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4acd59-acc4-44b7-86b7-bbe4a8b0a40f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.080194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.080863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.081142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.081409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.082089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:26.082395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.084028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b730cb-cb8c-4138-ab4c-c30d050596c9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.090279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 472/928] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:26.097384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.230945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0dfc-1437-4831-9612-7e30bc9f4f3f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.244451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372470-71f5-48eb-ad0a-1bf168d2a74a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.244832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372470-71f5-48eb-ad0a-1bf168d2a74a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.245191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3372470-71f5-48eb-ad0a-1bf168d2a74a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.247339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 473/929] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:26.254228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0c9-958e-487e-a1a2-ab5d61de7a69 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.254588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0c9-958e-487e-a1a2-ab5d61de7a69 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.255003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0c9-958e-487e-a1a2-ab5d61de7a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.259226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:26.275879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.276842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.277300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.277745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.278619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:26.278746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-804cf0c9-958e-487e-a1a2-ab5d61de7a69 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:26.279220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.280751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-804cf0c9-958e-487e-a1a2-ab5d61de7a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:26.281107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.287291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 457/930] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:26.370824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 474/931] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:26.398887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.520925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca615e5-226e-476f-b3e7-2b979f11774c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.560577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.562014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.562548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.563182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.564058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.565396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d664-0b32-4856-9ffc-124a4b79fa9f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.565680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d664-0b32-4856-9ffc-124a4b79fa9f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.565949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92d664-0b32-4856-9ffc-124a4b79fa9f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.566952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.568831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 475/932] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:26.572923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.573177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.573432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:26.579800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:26.581516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:26.582373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:26.585410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 458/933] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:26.591670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.592550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:26.593789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:26.647024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:26.666124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:26.676730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 476/934] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:26.702580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.727723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdb735-5fe2-4f8b-a492-1f26e0a3aeae None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.774975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.775608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.775890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.776168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.776986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:26.777298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.778686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.785505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 459/935] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:26.791937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.837135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2d83a-a34d-4bb4-a2e9-012a51b7d008 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.882710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.883730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.884220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.884781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.885683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.887376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.890244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING keystone.server.flask.common [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 05:59:26.916797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.sql.core [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:59:26.916797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:59:26.916797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [parameters: {'id': '4a792b0e46cd4c3691db747f747a5f34', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:59:26.916797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80323) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:59:26.920837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17026c22-34ee-4152-9ac1-66ef10fc0ca6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c8d648ca-cbe0-4dda-a6ad-3c27661240f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a792b0e46cd4c3691db747f747a5f34.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a792b0e46cd4c3691db747f747a5f34. Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:59:26.925060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 05:59:26.926031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application yield resource Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise self.value Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application session.commit() Jul 28 05:59:26.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:59:26.927952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:59:26.928910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application result.read() Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:59:26.929738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [parameters: {'id': '4a792b0e46cd4c3691db747f747a5f34', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.930629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:26.931432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a792b0e46cd4c3691db747f747a5f34. Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 477/936] 10.222.0.66 () {60 vars in 1140 bytes} [Thu Jul 28 05:59:26 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740597-f49e-449d-a7d9-848d4df24dae None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.932387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740597-f49e-449d-a7d9-848d4df24dae None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.935673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48740597-f49e-449d-a7d9-848d4df24dae None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.936182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 478/937] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:26.937995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740597-f49e-449d-a7d9-848d4df24dae None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:26.943112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:26.977900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:26.979816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.979816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.979816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:26.980131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:26.981776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:26.981888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811527-8895-4eb8-af79-a2fc4d67ef1a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:26.987929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 460/938] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:26.993960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:26.994245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:26.994528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.014890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:27.016572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:27.018558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:27.075540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48740597-f49e-449d-a7d9-848d4df24dae None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.094050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 461/939] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:27.095230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.127097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.128170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.128978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.129732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.138070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.139619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:27.151572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:27.152582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 479/940] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:27.153707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.211690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d9a2-d0bc-4f7c-b39e-fea3c3ee37d2 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.221323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:27.270591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.270591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.270591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.271012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.271631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] RBAC: Adding query filter params (interface=public, service_id=d5bf940a23044c2e872e4ac1be63cc74, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:27.271936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.273341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.285392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 462/941] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/endpoints?service_id=d5bf940a23044c2e872e4ac1be63cc74&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:27.285585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa29c-77e3-4109-b995-2f02c71d9295 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.285685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.298887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:27.333484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.333484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.333757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.333853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.345177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:27.350490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:27.351407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:27.352226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 480/942] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:27.353590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.402484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277e009-dc72-4244-9a02-dd1ca07a3bca None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.442781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.443496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.443780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.444054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.444801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:27.445108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.446533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.466073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 463/943] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:27.466073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.475749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d18ff-8b4c-4117-94b8-5b001ed19abf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.513464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:27.520342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.521125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.521405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.521678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.522341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.523746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.531248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 481/944] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:59:27.605299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7f81-ce72-442b-943c-79a9e73d9a30 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.660785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.661448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.661700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.661963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.662694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:27.662993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.664424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.675569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 464/945] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:27.681007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:27.729466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:27.798532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbb3d3-0057-46f7-82aa-d336085bc98b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:27.834406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:27.835053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:27.835381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:27.835640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:27.847064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:27.848511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:27.863271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:27.864175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:27.865129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:27.865129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:27.865129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:27.865129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:27.865129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 482/946] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:27.870491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.024051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:28.038778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfbad4-0053-43fc-9bb9-48b88fc3cb3c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.102406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.103047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.103323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.104429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.104429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:28.104761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.105953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.126093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 465/947] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:28.131926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.231222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:28.242313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714ad1-5a95-4a6c-a033-0030b069929d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.280694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.281680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.282163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.282712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.295122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.297650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-eb02f1bd-015e-4c0c-8cb5-7d02936eb291 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:28.310323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:28.311977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:28.313951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:28.317979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 483/948] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:28.324027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.440704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec126cb-8556-4f58-9176-0111df760043 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.477639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.478610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.479111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.479577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.480571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:28.481119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.482967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.502953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 466/949] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:28.508331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5678-f37c-4700-a5d7-01726699d017 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.508687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5678-f37c-4700-a5d7-01726699d017 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.508968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5678-f37c-4700-a5d7-01726699d017 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.509344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.510536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 484/950] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:28.516023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.516302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.516569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.524037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:28.540989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:28.543208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:28.622877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167f6f-ac9f-4cf3-adc9-1b667fb9b634 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.636304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 485/951] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:28.659036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.669380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.670668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.671275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.671752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.683301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.685184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:28.708500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:28.709603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:28.710486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:28.710486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:28.710486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:28.710486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:28.712618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 467/952] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:28.718203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:28.762719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:28.787980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee6934-a853-4355-80e3-f331bafa6751 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.793742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:28.832128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.832793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.833431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.833710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.834533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.835904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.837104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802cda9-ef07-43a3-81e6-9f2c686474bb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:28.853805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 486/953] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:28 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:28.885899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:28.886543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:28.886878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:28.887152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:28.887856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:28.888160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:28.889639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:28.904487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 468/954] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:28.910979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:29.031611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371ca3-24eb-49ee-a6cc-f02caa66beeb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:29.067025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:29.067664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.067932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.068199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.075032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:29.076573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:29.079448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:29.090492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:29.091669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:29.092834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:29.105393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 487/955] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:29.107729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:29.211120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf019a5-5789-4317-8947-f963ce3866a0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:29.230124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:29.250772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:29.251391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.252282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.252769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.253632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:29.253940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:29.255360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3df43-1d69-4b46-b7c1-2e891e491efb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:29.268007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 469/956] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:29.273626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:29.381163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b01e0-f58f-4c7c-a66a-0f284cdf7ba3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:29.416298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:29.417000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.417275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.417543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/ad22ebee6031482a866b0276d8506f46/roles/80f002492e8a4e2a8cbbb55e4f739a79` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.419715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=ad22ebee6031482a866b0276d8506f46, role_id=80f002492e8a4e2a8cbbb55e4f739a79)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:29.421459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdd369-9dff-4c7a-b422-b3220a906b13 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:29.437986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 488/957] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:29 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/ad22ebee6031482a866b0276d8506f46/roles/80f002492e8a4e2a8cbbb55e4f739a79 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:59:29.753522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979949da-56cc-4baf-b33b-0f9a49a8eb8b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.754057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979949da-56cc-4baf-b33b-0f9a49a8eb8b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.754246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979949da-56cc-4baf-b33b-0f9a49a8eb8b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.755958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 470/958] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:29.761373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.761776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.762140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.780749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:29.781924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:29.823549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138070c9-a687-4a7c-94f3-f4469d43435a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.823874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138070c9-a687-4a7c-94f3-f4469d43435a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.824115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138070c9-a687-4a7c-94f3-f4469d43435a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.825747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 471/959] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:29.831028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:29.831314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:29.831596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:29.840521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:29.850507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:29.851956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:29.856721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 489/960] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:29.880700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:29.946184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 472/961] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:29.971420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:29.995108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fe95-f079-4f1c-9844-1d839b38266e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.031722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.032453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.033349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.033680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.034382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.035828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:30.045736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:30.046986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:30.047917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:30.056679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 490/962] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:30.056679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:30.076192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6d8e-4c8a-4b87-999e-de19cbe44965 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.092126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:30.122428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:30.124054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.124883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.125329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.125632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.126451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.128011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.130861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING keystone.server.flask.common [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 05:59:30.145426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.sql.core [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:59:30.145426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:59:30.145426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [parameters: {'user_id': '0164f8db169349028e0200c92cc00a4f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:59:30.145426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80322) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application result.read() Jul 28 05:59:30.164230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:59:30.165344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application yield resource Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise self.value Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application session.commit() Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:59:30.166293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:59:30.167188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:59:30.168523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application result.read() Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:59:30.170082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [parameters: {'user_id': '0164f8db169349028e0200c92cc00a4f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:30.171694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 05:59:30.172735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.174517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 473/963] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jul 28 05:59:29 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:30.177171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:30.190791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8cfd6-948e-4b01-a2f6-d70d7d0eed4e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.230128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.231166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.231663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.232169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.233013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:30.233485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.235098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.246409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 491/964] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:30.247865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:30.288296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945cd2-cd35-4617-add2-302c93ce6aad None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.324884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.326020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.326020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.326462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.337336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.339224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:30.351567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:30.352733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:59:30.353887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:30.355600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 474/965] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:30.361387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:30.362529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed133ff-c748-4412-9be6-7a5b2dd6b71b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.381631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:30.396292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:30.403509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.404753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.405206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.405623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.406433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:30.406947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.408660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.419074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 492/966] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:30.420492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:30.474007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69247-07b5-4a4a-86d2-fbb0d80eca22 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.519327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.519947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.520233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.520505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.521405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:30.521715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.523251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876fa2a-2fd9-49e9-9190-c30cfd3295b7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.531567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7de63-5d4c-435e-8371-519a61cd8480 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:30.565364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 475/967] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jul 28 05:59:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:30.567552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:30.568428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:30.568925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:30.569370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:30.570267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:30.571888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab6ceb-2d11-49b9-a082-efae172ac33b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:30.601896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 493/968] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:59:31.079893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd675-bdd1-4c21-a42d-e7170679d49b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.080433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd675-bdd1-4c21-a42d-e7170679d49b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.080433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd675-bdd1-4c21-a42d-e7170679d49b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.083503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 476/969] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:31.087850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.088279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.088469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.107534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:31.108552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:31.140167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.188134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 494/970] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:31.211008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd675-bdd1-4c21-a42d-e7170679d49b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.305307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.320041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd675-bdd1-4c21-a42d-e7170679d49b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.357328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.358094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.358475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.358871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.359625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:31.361645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a4101acc-f418-4ff5-9084-d3530370c88a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:31.371155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:31.372365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:31.373446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:31.374408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 477/971] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:31.381299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.481757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e054349-f7d8-4705-a19a-df2dcef985f5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.516427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.517591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.517871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.518138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.518808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:31.519106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:31.520460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e5ee-e95c-4947-a1a5-78b35d6c6a0b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:31.529953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 495/972] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:31.530131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a3894-e493-46f6-9cb4-887413914f90 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.530131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a3894-e493-46f6-9cb4-887413914f90 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.530131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a3894-e493-46f6-9cb4-887413914f90 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.530131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 478/973] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:31.532504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a3894-e493-46f6-9cb4-887413914f90 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.533379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f652c-d722-4d66-b9e4-67468648463a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.533748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f652c-d722-4d66-b9e4-67468648463a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.534020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f652c-d722-4d66-b9e4-67468648463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.555217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-179f652c-d722-4d66-b9e4-67468648463a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:31.556411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-179f652c-d722-4d66-b9e4-67468648463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:31.584445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.644217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 496/974] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:31.651910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a3894-e493-46f6-9cb4-887413914f90 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.667364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f652c-d722-4d66-b9e4-67468648463a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.695117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.695745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.696026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.696299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.697030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:31.697339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:31.698773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:31.704247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 479/975] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:31.711091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.730124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.775668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f652c-d722-4d66-b9e4-67468648463a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.811786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.812476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.812741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.813173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.823774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:31.823950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a121-ed7f-4e38-b4bc-2a8b4414b3e8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:31.828738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:31.829751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:31.830612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 497/976] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:31.836021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.856312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.868323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.868977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:31.869362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:31.869633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:31.870498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] RBAC: Adding query filter params (interface=public, service_id=c6626bdf98424cca87e4bebe64376a4c, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:31.870808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:31.872166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:31.877632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 480/977] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/endpoints?service_id=c6626bdf98424cca87e4bebe64376a4c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:31.883002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:31.954323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732062-a9de-4a77-9b50-c3c150389858 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:31.979896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:31.998374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:31.999698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.000258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.000711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.001616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:32.001785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4e2c1-e08e-421e-b536-6e83bacbba13 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.002222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.004784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.014520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 498/978] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:32.020405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.038118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.038718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.039075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.039346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.039987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.041366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.056672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 481/979] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:31 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:59:32.132408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:32.156343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650195e-28c7-4b71-b601-0aff308873b0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.193782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.194440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.194721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.194992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.208202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.209722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:32.227572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:32.228592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:32.229562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:32.229562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:32.229562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:32.229562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:32.229562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 499/980] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:32.234481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.337933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244dd3-906d-44ad-9266-174c717c489d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.372849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.373474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.373749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.374018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.374708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:32.375011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.376398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.390809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 482/981] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:32.395995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.498643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45ae4-f12c-498b-a5cd-a5c2df371c93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.527302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:32.534934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.535582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.535860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.536129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.544130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.545590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-aca5903d-bdb8-48ff-86d7-7ce3865e6a4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:32.558028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:32.558998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:59:32.559954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:32.564684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 500/982] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:32.565591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.569551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:32.678139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e827ce-55a0-4762-8355-28f8842537c1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.692169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb1d-bf2b-4bea-a60b-67bb10a41db1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.692446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb1d-bf2b-4bea-a60b-67bb10a41db1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.692746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedb1d-bf2b-4bea-a60b-67bb10a41db1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.694355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 501/983] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:32.699538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.699819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.700089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.716549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.717217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.717495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.717767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.718560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:32.718875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.720905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.726293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:32.727718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:32.753422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 483/984] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:32.767646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.804394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 502/985] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:32.827436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:32.849765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:32.891206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eac9ea-eefa-4b5a-a019-9a5199e0de7b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.927924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.928590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.928921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.929212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.933818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82e4-df02-4ecf-a916-756dd86ade43 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:32.957534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:32.970112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:32.971529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:32.971875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:32.972212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:32.972935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:32.974433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:32.983920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:32.985177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:32.986239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:32.987605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 503/986] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:32.993352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.005884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.007265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.072668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.105366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897177-cf6b-44f6-8aaf-a013fac8ebe8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.133298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 484/987] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:33.135222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.139472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.140092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.140369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.140651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.141328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:33.141630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.143610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.148685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 504/988] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:33.157739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.221035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.252301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f361b6-3e4f-4a79-b72e-a4b1faf50b1a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.276867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de5ba-5cf1-4b98-b760-3fae2193e2dd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.290430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.291551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.291985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.292252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.304883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.306112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.319077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.319835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.320227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.320590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.321673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:33.322068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.323536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:33.326793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:33.327689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:33.328700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:33.328700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:33.328700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:33.328700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:33.332393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 505/989] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:33.332779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 485/990] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:33.334347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.338421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.356796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.443720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833384b8-93f3-42c2-837f-0b07ca9e01c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.445829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3054275-3915-4c16-bebd-3e52a3d365b7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.459198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.481502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.482032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.482154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.482391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.482652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.482750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.482934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.483208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.483372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:33.483629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.483960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] RBAC: Adding query filter params (interface=admin, service_id=d5bf940a23044c2e872e4ac1be63cc74, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:33.484270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.485047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.485663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.495234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 486/991] 10.222.0.66 () {56 vars in 1249 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/endpoints?service_id=d5bf940a23044c2e872e4ac1be63cc74&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:33.496205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.501632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 506/992] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:33.507204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.588457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.611878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c53c4-7c3c-4c73-b129-29ac10691521 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.613923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b1648-62bd-43ad-ba19-d739c8a3b907 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.648237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.648898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.649213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.649441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.649831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.650447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.650726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.650997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.651649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.653052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.657485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.659237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.660353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 487/993] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:33.677140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:33.678144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:33.679039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:33.680168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 507/994] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:33.688488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.801306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9c333-1ff2-45a5-8032-82eccb705b4d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:33.838154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:33.838844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:33.839052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:33.839335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:33.840078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:33.840384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:33.842452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eef5-9f27-42f4-ab50-aa0a5785384c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:33.854993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 488/995] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:33.861772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:33.897244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:33.966149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6989a7-4d04-40ec-b1f6-0967fea950fe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:34.002304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:34.002922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.003203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.003470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.004249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] RBAC: Adding query filter params (role.id=80f002492e8a4e2a8cbbb55e4f739a79, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=ad22ebee6031482a866b0276d8506f46) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:34.004557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:34.006002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10065e-1730-4953-ab0c-0e517e828684 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:34.017679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 508/996] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:33 2022] GET /identity/v3/role_assignments?user.id=ad22ebee6031482a866b0276d8506f46&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=80f002492e8a4e2a8cbbb55e4f739a79 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:34.136136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96b454-7b32-4bf3-b92f-17bed056f780 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.136426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96b454-7b32-4bf3-b92f-17bed056f780 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.136729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96b454-7b32-4bf3-b92f-17bed056f780 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.138122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 489/997] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:34.144394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.144956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.144956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.163533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:34.165417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:34.238172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 509/998] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:34.261182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96b454-7b32-4bf3-b92f-17bed056f780 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:34.264192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:34.369141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96b454-7b32-4bf3-b92f-17bed056f780 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:34.405172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:34.405821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.406096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.406360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.406983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:34.408910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:34.418125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:34.419149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:59:34.420411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:34.424710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 490/999] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:34.426942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:34.456710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:34.531352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5253f-2a5a-4f26-9730-4cee88ec44e2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:34.566319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:34.567618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.567618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.567618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.569501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:34.569501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:34.569785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:34.577139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 510/1000] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:34.583941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:34.653517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:34.691030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc54ae2-0ed4-4c6d-9553-2972b50e3a50 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:34.725134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:34.725756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.726030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.726297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.727032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:34.727359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:34.728758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1d77b-5f5d-4f62-8514-5179c13af548 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:34.734114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 491/1001] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jul 28 05:59:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:34.742345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:34.838398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:34.849177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294d865-3e46-4078-8e2e-524a6a18d667 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:34.883435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:34.884050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:34.884330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:34.884600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:34.885334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:34.886681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300de50-f40e-48f1-90e2-3dc379b07607 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:34.907073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 511/1002] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:35.711774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ead4c-29e8-4155-b247-42d08fb78829 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:35.712294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ead4c-29e8-4155-b247-42d08fb78829 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:35.712294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ead4c-29e8-4155-b247-42d08fb78829 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:35.713759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 492/1003] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:35.718846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:35.719270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:35.719439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:35.738163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:35.739341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:35.817811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 512/1004] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:35 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:35.840863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ead4c-29e8-4155-b247-42d08fb78829 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:35.945117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ead4c-29e8-4155-b247-42d08fb78829 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:35.974069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:35.982802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:35.983173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:35.983336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:35.983617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:35.984224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:35.985615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-15be7c9b-6900-4b48-b97f-15c3a49fdb0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:35.995379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:35.996391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:59:35.997689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:35.998866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 493/1005] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jul 28 05:59:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:36.005027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.087421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bd89-9b4d-41d1-9b4a-6becebbbb5bb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.088281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bd89-9b4d-41d1-9b4a-6becebbbb5bb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.088566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827bd89-9b4d-41d1-9b4a-6becebbbb5bb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.090124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 494/1006] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:36.096372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.096673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.096965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.106019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:36.124537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:36.127096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:36.135755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88056d8-edc2-478f-941a-4eb776ead295 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.177552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.178164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.178448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.178718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.179393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:36.179700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.181089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.186640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 513/1007] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:36.192718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.205143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 495/1008] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:36 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:36.226579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.299506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb877-eaa9-4188-ac87-d5ef2eec9a2e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.327456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f781cb-45e7-4850-bf6a-469cc6b58885 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.336367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.340818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.341137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.341418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.342124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:36.342512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.343804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.349670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 514/1009] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jul 28 05:59:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:36.355480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.358446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:36.359047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:36.372104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.372762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.373047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.373322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.373968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.375322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:36.384630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:36.385858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:36.387012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:36.390640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 496/1010] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jul 28 05:59:36 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:36.391527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.472055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2bc3a-d62a-4c23-b47a-303efde0a1f7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.500958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3debb-cf13-49ab-a3fd-6622538d30e4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.509548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.510250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.510596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.510893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.511574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.512961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.530240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 515/1011] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:36.550303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.550946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.551260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.551529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.552195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] RBAC: Adding query filter params (name=image) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:36.552495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.554001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bb5ae-964d-4ad1-85dd-5e1a0ff15d31 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.564979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 497/1012] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:36.567248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:36.638574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:36.684922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b425f8e-3114-48ac-b698-a5c1c8573312 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:36.728423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:36.729411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:36.729411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:36.729681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:36.730281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:36.730584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:36.732707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bf642-7cfc-49fc-a040-3f0371a0c84b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:36.737869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 516/1013] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:37.026706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7447c8-4284-4084-aeb9-125a68d31163 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.027223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7447c8-4284-4084-aeb9-125a68d31163 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.027223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7447c8-4284-4084-aeb9-125a68d31163 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.028901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 498/1014] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:37.034597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.034879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.035151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.054106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:37.055301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:37.132483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 517/1015] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:37.155656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7447c8-4284-4084-aeb9-125a68d31163 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:37.210518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:37.268807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7447c8-4284-4084-aeb9-125a68d31163 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:37.304391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:37.304995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.305271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.305541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.317292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:37.322141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:37.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:37.323919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 499/1016] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:37.332669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:37.393428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:37.443186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612b1c-3156-4c3e-a209-2dde1317eab6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:37.495037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:37.496028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.496385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.496868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.497968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:37.498478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:37.500719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:37.516735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 518/1017] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:37.520371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:37.625691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54c72-c8f6-4c4c-afba-a9daab64de4e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:37.634906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:37.663841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:37.664493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.664805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.665081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.676867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:37.678324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:37.693039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:37.694010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:37.694908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:37.694908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:37.694908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:37.694908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:37.697001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 500/1018] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:37.700144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:37.808836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b65c93-2d51-47ed-8bf5-f0780fe9c7c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:37.825838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:37.844058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:37.844862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:37.845672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:37.845896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:37.846539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:37.846840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:37.848186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:37.864805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 519/1019] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:37.872024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:37.980628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034feb1-6bfa-40cf-896d-5bb58591346c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:38.018982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:38.019633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.019916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.020193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.028442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:38.030025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:38.042872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:38.043877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:38.044896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:38.048970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 501/1020] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:38.050611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.161738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f09c65-e25a-4b1a-95cc-b6030aa694a2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:38.200413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:38.201059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.201341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.201609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.202469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:38.202777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:38.204185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:38.222226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 520/1021] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:59:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:38.227698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.252523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:38.333361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550094-6108-4d65-89be-36e9dfdde31d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:38.369573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:38.370182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.370458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.370797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.448783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:38.450226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a713bf8-6e98-403f-9896-b75f115b87a6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:38.471928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:38.569904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 502/1022] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:38 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:38.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.625470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:38.627312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae95913-2b53-48ca-8dad-b4082eba4384 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.627657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae95913-2b53-48ca-8dad-b4082eba4384 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.627934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae95913-2b53-48ca-8dad-b4082eba4384 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.629488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 503/1023] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:38.635077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.635367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.635642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.654697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:38.655989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:38.708911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53afe-d64c-49ad-afed-431756f901ba None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:38.727550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 504/1024] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:38.750014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:38.750223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.751155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.751683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.752278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.764098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:38.765246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-395ecee1-aa9c-43c3-9cba-8960aec838e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:38.786498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:38.787458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:38.788474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:38.788474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:38.788474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:38.788474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:38.788474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 521/1025] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:38.789677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51990-342b-49e9-b52c-a92665aa384f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.789677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51990-342b-49e9-b52c-a92665aa384f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.789930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb51990-342b-49e9-b52c-a92665aa384f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.791224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 522/1026] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:38.796457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163656-cd20-454a-9d59-7a998a42617a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.796794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163656-cd20-454a-9d59-7a998a42617a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.797071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17163656-cd20-454a-9d59-7a998a42617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.807318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:38.815586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-17163656-cd20-454a-9d59-7a998a42617a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:38.816816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17163656-cd20-454a-9d59-7a998a42617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:38.864005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db788-92d4-4dde-8954-e878778f94a7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:38.883905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 523/1027] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:38.884777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163656-cd20-454a-9d59-7a998a42617a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.900254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:38.900938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:38.901222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:38.901837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:38.903007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:38.904452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:38.906279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 505/1028] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:38.908182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:38.909611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:38.997644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17163656-cd20-454a-9d59-7a998a42617a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.008475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05920e-6ffa-422f-aee5-538daf67469a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.026973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:39.031494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.032109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.032382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.033835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.034029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:39.034326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.035684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.044727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.045344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.045619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.045886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.046569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.046729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 524/1029] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:39.047494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:39.048957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.064841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 506/1030] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:38 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:59:39.065680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:39.150767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:39.177334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a15-4b87-4f73-bdcb-9da4c29d9be7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.216275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c1894-59f6-482b-9008-690c54589c9f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.222129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.222755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.223033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.223302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.223991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.225443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.258300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 525/1031] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 05:59:39 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:39.262738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.263405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.263688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.263963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.272377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.273925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:39.286600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:39.287742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:39.288825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 507/1032] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:39.294166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:39.406718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f333898-ba33-4e81-989a-7b66ccf4eb63 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.439740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:39.448108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.448789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.449329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.449780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.450624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:39.451145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.452587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1f04-caaf-4bfd-9cc6-b0912a21e66b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.465367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 526/1033] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:39.471688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:39.509783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:39.583181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb149ad9-91c5-4425-a25b-7803a9fe6042 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:39.618559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:39.619184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:39.619463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:39.619732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:39.620516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] RBAC: Adding query filter params (role.id=80f002492e8a4e2a8cbbb55e4f739a79, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:39.620851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:39.622271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb755-0b4f-4ad2-8143-d64f4d5bde3d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:39.628264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 508/1034] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:39 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=80f002492e8a4e2a8cbbb55e4f739a79 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:41.154928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d866a-776a-4b68-9338-8474d80d792f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.155915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d866a-776a-4b68-9338-8474d80d792f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.155915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d866a-776a-4b68-9338-8474d80d792f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.156845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 527/1035] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:41.162405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4247-e64f-46bf-9924-750c18ce6280 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.162809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4247-e64f-46bf-9924-750c18ce6280 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.162964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4247-e64f-46bf-9924-750c18ce6280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.182003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e5fc4247-e64f-46bf-9924-750c18ce6280 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:41.183188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e5fc4247-e64f-46bf-9924-750c18ce6280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:41.264704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 509/1036] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:41.281903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d866a-776a-4b68-9338-8474d80d792f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.348816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d1feb-f478-4bc6-b526-f17d9c8be6df None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.349013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d1feb-f478-4bc6-b526-f17d9c8be6df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.349279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d1feb-f478-4bc6-b526-f17d9c8be6df None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.350630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 510/1037] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:41.355605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.356096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.356724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.376310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:41.377979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:41.391047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d866a-776a-4b68-9338-8474d80d792f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.404499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:41.427919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.428564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.428866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.429135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.429753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:41.431098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:41.440742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:41.441757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:41.442629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 528/1038] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:41.447752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.459047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 511/1039] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:41.484088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.521526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:41.572038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d5f97-76c0-4b60-9a8f-caa8c06bff06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.594047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8c3ac-929d-41a8-b144-e7c556a819d4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.616491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.617241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.617658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.618509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.619133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] RBAC: Adding query filter params (name=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:41.619642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:41.621415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099789-c78b-4840-a85e-86b11ee91916 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:41.628754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 529/1040] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:41.636358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc63741-2c5f-4737-98d4-540db3fe78dd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.637192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc63741-2c5f-4737-98d4-540db3fe78dd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.637473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc63741-2c5f-4737-98d4-540db3fe78dd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.638838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 530/1041] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:41.639618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc63741-2c5f-4737-98d4-540db3fe78dd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.645348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.646351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.647241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.647241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.648193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:41.649858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdeebc3-c3db-4d01-810c-9b6625c4f37c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:41.651560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 512/1042] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:41.653150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.653150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.653308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.674293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:41.675542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:41.697138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:41.750572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 513/1043] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:41.752675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.765790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc63741-2c5f-4737-98d4-540db3fe78dd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.798464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:41.820794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.821410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.821681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.821945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.822648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:41.822946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:41.825149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:41.838771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 531/1044] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:41.838771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.882379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46530d22-a709-40ef-bc88-8c2439edeb3d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.918618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.919249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.919536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.919807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:41.920493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:41.921962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:41.944937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9186-f908-4c29-91c9-1fb723d1e769 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:41.945246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 514/1045] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:59:41 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:41.945983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:41.977994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:41.992617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:41.993467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:41.993672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:41.993901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.007802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:42.014009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:42.015209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:42.016262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 532/1046] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:42.021995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.076994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:42.110587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accaf49e-7c15-41ab-b1cd-c295c423881b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.151462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f75b-4971-4ff3-a10c-fcf7fff6656d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.160341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.161002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.161276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.162283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.163046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] RBAC: Adding query filter params (interface=public, service_id=5fa9c4e1656d43d081f8474efd96fd40, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:42.163587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.164955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.174157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 515/1047] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 05:59:41 2022] GET /identity/v3/endpoints?service_id=5fa9c4e1656d43d081f8474efd96fd40&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:42.180004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.195759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.196504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.196892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.197171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.197888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:42.198196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.199559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.210023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 533/1048] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:42.215767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.285067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:42.324682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0876-de14-4536-bfc5-e1ee8dafdb30 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.371796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5bfe4-3dc7-4d1d-9783-b18e9892ef1f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.376800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:42.378586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.379242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.379503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.379769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.380429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.396688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 516/1049] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/services => generated 1957 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:59:42.422861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.423966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.424394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.424906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.437110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.438622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:42.456732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:42.458117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:42.459245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:42.459245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:42.459245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:42.459245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:42.463178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 534/1050] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:42.464405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.594348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b664-387a-4d7a-a4b6-b7dcce02a839 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.631187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.631807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.632082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.632350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.633065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:42.633370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.634722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.644759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:42.652582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 517/1051] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:42.653805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.760957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a91d0d-5db6-4437-87e0-19142445ac33 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.795905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.796535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.796834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.797103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.805781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.807198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:42.818654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:42.819626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:42.820589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 535/1052] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:42.827142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:42.940262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5614-e399-4e8d-960f-ba27ec2f240d None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:42.974770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:42.975388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:42.975664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:42.975933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:42.976736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:42.977042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:42.978453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.000856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 518/1053] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:43.002138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:43.021169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:43.126352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8042-16c8-4b41-8a4a-9f7fd4e74b90 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:43.166618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:43.167255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:43.167525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:43.167789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:43.179880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:43.181358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:43.196154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:43.197554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:43.198492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:43.198492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:43.198492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:43.198492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:43.198492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 536/1054] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:43.205760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:43.267392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:43.310013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e148-595d-4886-8498-26aab2c501b7 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:43.344434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:43.345185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:43.345452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:43.345731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:43.346472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:43.346691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:43.348044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.364375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 519/1055] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:43.365858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:43.435349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:43.477607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e156e-5ec0-40fc-8b5f-d30b479afd20 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:43.513170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:43.513894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:43.514174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:43.514445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:43.521978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:43.523410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:43.535872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:43.537034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:43.537950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 537/1056] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:43.544538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:43.652197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ff945-ccc6-4663-928c-8893789ccfb8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:43.669929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:43.688239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:43.689805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:43.689974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:43.690147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:43.690853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:43.691152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:43.692765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369be3-8815-48ad-87eb-34afcf54ee39 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.706156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 520/1057] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:43.712394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:43.821355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611eec-a82b-4551-b11b-530542c6dfb7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:43.849315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:43.858345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:43.859497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:43.859973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:43.860450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/80f002492e8a4e2a8cbbb55e4f739a79` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:43.863953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=b65b1e894e3d4d2eb08b7cddfeff1822, role_id=80f002492e8a4e2a8cbbb55e4f739a79)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:43.866206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf18f77-ed22-480b-8ab3-60477c7d4f3d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:43.886446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 538/1058] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:43 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/b65b1e894e3d4d2eb08b7cddfeff1822/roles/80f002492e8a4e2a8cbbb55e4f739a79 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:59:44.080050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf230a-3083-41a4-bdfd-13b538999bad None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.080254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf230a-3083-41a4-bdfd-13b538999bad None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.083700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf230a-3083-41a4-bdfd-13b538999bad None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.083700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 521/1059] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:44.088027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.088314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.088589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.107891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:44.109123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:44.197995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 539/1060] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:44.220895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf230a-3083-41a4-bdfd-13b538999bad None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.326340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf230a-3083-41a4-bdfd-13b538999bad None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.361270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.361842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.362120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.362392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.374736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a2bfc9e5-efdb-412b-8454-10ab3e2722f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:44.379687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:44.380664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:44.381561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:44.384968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 522/1061] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:44.386800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.489759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc666444-2fa1-4a9b-87f0-db623f4f2681 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.494042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273725-27d1-439e-98c6-00e1793dc926 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.494329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273725-27d1-439e-98c6-00e1793dc926 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.494602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273725-27d1-439e-98c6-00e1793dc926 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.496084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 523/1062] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:44.500818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.501633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.501908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.513121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:44.522102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:44.523241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:44.529977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.530603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.531301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.531585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.532324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:44.532656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:44.534482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:44.548812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 540/1063] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:44.550676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.566371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:44.609700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 524/1064] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:44.634323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.670563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9cb90-50fe-4ae3-a67e-8978c08c36e2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.709378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.710018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.710296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.710564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] PATH_INFO: `/v3/users/131f3cda03c448b784f5845ca8a7ddeb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.728630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] RBAC: Authorizing `identity:get_user(user_id=131f3cda03c448b784f5845ca8a7ddeb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:44.730144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:44.731871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 541/1065] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/users/131f3cda03c448b784f5845ca8a7ddeb => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:44.738623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.762784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0061a-1130-4e7f-8c49-81e93717e15d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.788121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:44.798888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.799537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.799814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.800089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] PATH_INFO: `/v3/services/image` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.800729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:44.802137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:44.810936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:44.812431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:44.813594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 525/1066] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:44.818643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:44.851910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:44.866609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae469cb2-2f2a-42a0-b03c-92a6d8dbcc93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.914745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.915756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.916383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.916904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.934539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d453a-4688-4339-b795-a24cb3243f6f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:44.969887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:44.970514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:44.970797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:44.971071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:44.971797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] RBAC: Adding query filter params (name=image) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:44.972105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:44.973499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:44.983213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 526/1067] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:44.984448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:45.000116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:45.002270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:45.047292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:45.102819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:45.110271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013f033-10f9-49ea-a8ef-6d22e8200239 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:45.133216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 542/1068] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:59:45.138728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:45.152575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:45.153237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.153513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.153783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.154458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] RBAC: Adding query filter params (type=image) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:45.154761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:45.156135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:45.171396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 527/1069] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:45.173809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:45.249656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fea375-045f-47e2-a670-d3d3c4f4583a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:45.286890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:45.287598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.287877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.288146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.289373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:45.290816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:45.292633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 543/1070] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:59:45 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:45.299119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:45.303824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f35d-1f21-44b6-95dd-d827bcbe4a85 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:45.308765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:45.343641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:45.344272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.344551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.345442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.346173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:45.347515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fa3f3-7bdb-4251-9789-2d9e11ee7dd3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:45.369207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 528/1071] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 05:59:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:59:45.432010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236956-1957-4811-8120-30eb826b7c1d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:45.484291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:45.484964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.485249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.486060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.486864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=988619def44e4ae8890c8e103bd393e3, user.id=131f3cda03c448b784f5845ca8a7ddeb) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:45.487162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:45.488627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b03eac-1110-4a1b-a6be-164b768f3858 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:45.500696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 544/1072] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:45 2022] GET /identity/v3/role_assignments?user.id=131f3cda03c448b784f5845ca8a7ddeb&scope.project.id=988619def44e4ae8890c8e103bd393e3&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:45.967035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263501b-85cc-49b8-8b18-8a41e44e6dbe None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.967298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263501b-85cc-49b8-8b18-8a41e44e6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.967621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263501b-85cc-49b8-8b18-8a41e44e6dbe None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.969003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 529/1073] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:45.974640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:45.974925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:45.975197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:45.994733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:45.995925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:46.064874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:46.074781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 545/1074] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:46.098580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263501b-85cc-49b8-8b18-8a41e44e6dbe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:46.119167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:46.211808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263501b-85cc-49b8-8b18-8a41e44e6dbe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:46.257840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:46.258456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:46.258730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:46.258993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:46.270440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:46.275381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:46.276315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:59:46.277195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:46.281875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 530/1075] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jul 28 05:59:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:46.283949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:46.423359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4c642-966f-4c11-9892-dfaec1261661 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:46.466605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:46.467268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:46.467545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:46.467842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:46.468551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:46.468904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:46.470939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:46.483813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 546/1076] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 05:59:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:46.490034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:46.592412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:46.628709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239a0f-f5ca-47a3-a309-4dcba8a12b3a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:46.675612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:46.676383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:46.676610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:46.677039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:46.689468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:46.691639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:46.708923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:46.709932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:46.715756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:46.715756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:46.715756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:46.715756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:46.715756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 531/1077] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:46.718336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:46.789504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:46.836761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683fe7-82bc-497c-8457-078f6ba45822 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:46.880799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:46.881399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:46.881689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:46.881962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:46.882658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:46.882957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:46.884316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:46.899732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 547/1078] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:46.906932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.030113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef08bd-4b13-4fe3-8fca-671649e0ae22 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:47.064760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.076356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:47.077692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.077857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.078271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.099728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:47.099728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:59:47.120484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:47.121931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:59:47.123100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:47.124237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 532/1079] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jul 28 05:59:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:59:47.132542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.274767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea6a5b-d3ee-4992-8f1b-7f8a0d502f62 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:47.294780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.319060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:47.319447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.319688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.319960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.320848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:47.321149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:47.322639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750988e-3238-4cc0-be4f-f20de746ed2c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:47.346620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 548/1080] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jul 28 05:59:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:47.352368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.461876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58192ddd-4d6f-4a5a-98ac-1968a96260de None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.462067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58192ddd-4d6f-4a5a-98ac-1968a96260de None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.462324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58192ddd-4d6f-4a5a-98ac-1968a96260de None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.463709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 549/1081] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:47.473227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb7d-a647-453e-8a2f-1d8e3236b403 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.473659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb7d-a647-453e-8a2f-1d8e3236b403 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.473933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb7d-a647-453e-8a2f-1d8e3236b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.477404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce31904-e18c-4ab6-bfd3-1072bd69ed6f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:47.493680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9d8beb7d-a647-453e-8a2f-1d8e3236b403 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:47.494916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d8beb7d-a647-453e-8a2f-1d8e3236b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:47.515353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:47.516084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.516271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.516535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.574816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 550/1082] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:47.584091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40924-c87b-46ed-ab10-f736d4903015 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.584386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40924-c87b-46ed-ab10-f736d4903015 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.584733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40924-c87b-46ed-ab10-f736d4903015 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.586828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 551/1083] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:59:47.589533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.592094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.592355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.592655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.607104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:47.608547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:47.611562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:47.612798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:47.682688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 552/1084] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:47.683544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.721412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 533/1085] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:47.721412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.731175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.809222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.822550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7100a4-0dbf-4b82-b542-92027cb9b7ea None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:47.835967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57c8a-86fc-43f2-9fb9-bf497ce906ad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:47.856786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:47.857426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.857703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.857974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.870254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:47.875143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:47.876147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:47.877556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 534/1086] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:47.878815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:47.884215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:47.884928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:47.885203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:47.885468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:47.956781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:47.958502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:47.992737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:47.993841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62081737-bd67-4af8-89e5-b14a2e77aaf3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.029854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.030593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.030868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.031138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.042525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.043979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.056964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.062867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 553/1087] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:48.064761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:48.065826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:48.066930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:48.066930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:48.066930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:48.066930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:48.067165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.069448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 535/1088] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:48.070389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.172514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891187a-af81-4150-a202-cd28b2a45691 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.185892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd6bb-ec11-47d6-a6b2-77dcd7c159e4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.212721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.213376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.213650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.213917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.214629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:48.214929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.216292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.218690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.224892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.225722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.226187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.226323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 554/1089] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:48.226640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.227039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.245283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.246661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:59:48.261720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:48.262893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 536/1090] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:48.263830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.331523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.341575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba978d50-41e8-4121-8427-2a7a5900fcb1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.378826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.379439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.379714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.379980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.380481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b7a5e-9c15-43a8-bc57-05b17af490b3 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.380678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:48.380981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.382333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.395016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 555/1091] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:48.395839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.426458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.427314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.427760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.428207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] PATH_INFO: `/v3/users/131f3cda03c448b784f5845ca8a7ddeb` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.435600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] RBAC: Authorizing `identity:get_user(user_id=131f3cda03c448b784f5845ca8a7ddeb)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.435600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.435600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 537/1092] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/users/131f3cda03c448b784f5845ca8a7ddeb => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:48.435600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.474155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.519066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7667f74-c4b2-4cd5-899a-0c13d3d85f86 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.554248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee47d2-471e-4958-96eb-9b562ecc626c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.557861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.558479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.558752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.559016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.559703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:48.559999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.561710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.574145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 556/1093] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:48.575085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.584460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.610155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.611802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.612087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.612354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.620905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.622368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:59:48.635476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:48.636493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 05:59:48.637438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 538/1094] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:48.642871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.700829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed00805-74fc-417c-9e0b-8927850cec08 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.722797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.743234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.744287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.744287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.744479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.745576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.747885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.748781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 557/1095] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:48.755625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.764373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181b16d-be48-4d79-a985-e592cc347ef4 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.809481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.810121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.810455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.810869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.811627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:48.811931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.813957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.831518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 539/1096] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:48.838427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:48.890025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4b115-c96a-4abd-a08e-6eeb00025e69 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.890265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:48.925910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.926938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.927215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.927801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3/users/131f3cda03c448b784f5845ca8a7ddeb/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.929488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=988619def44e4ae8890c8e103bd393e3, user_id=131f3cda03c448b784f5845ca8a7ddeb, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.931370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f89e3-f0fc-4895-8fa1-b20948e0a3e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:48.950001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 558/1097] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 05:59:48 2022] PUT /identity/v3/projects/988619def44e4ae8890c8e103bd393e3/users/131f3cda03c448b784f5845ca8a7ddeb/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:59:48.950292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995da54-2ec2-43aa-9bce-990ad9e94402 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:48.989304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:48.989944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:48.990218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:48.990486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:48.991281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] RBAC: Adding query filter params (role.id=80f002492e8a4e2a8cbbb55e4f739a79, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=b65b1e894e3d4d2eb08b7cddfeff1822) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:48.991589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:48.993067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a37a8-4eeb-4364-ac29-fafcd19268b1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:49.008783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 540/1098] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:48 2022] GET /identity/v3/role_assignments?user.id=b65b1e894e3d4d2eb08b7cddfeff1822&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=80f002492e8a4e2a8cbbb55e4f739a79 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:59:50.982555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc75a2-25fc-418b-96f2-82d278c79b8a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:50.983116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc75a2-25fc-418b-96f2-82d278c79b8a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:50.983116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc75a2-25fc-418b-96f2-82d278c79b8a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:50.984447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 559/1099] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:50.991372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:50.991850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:50.991952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:51.011053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:51.012245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:51.085628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 541/1100] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:51.108973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc75a2-25fc-418b-96f2-82d278c79b8a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:51.159496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:51.221084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc75a2-25fc-418b-96f2-82d278c79b8a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:51.256830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:51.257381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:51.257655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:51.257921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:51.268549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:59:51.273381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:59:51.274446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 05:59:51.275568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 560/1101] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 05:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:59:51.280849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:51.314328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:51.379978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feea6df-3530-49d5-957f-404105bd4eed None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:51.416515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:51.417157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:51.417436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:51.417705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:51.418409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:51.418711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:51.420067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:51.428715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 542/1102] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 05:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:51.434542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:51.535190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d778-4280-4442-95b9-75692b17b343 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:51.543265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:51.575752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:51.576884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:51.577266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:51.577540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] PATH_INFO: `/v3/users/131f3cda03c448b784f5845ca8a7ddeb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:51.579537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=131f3cda03c448b784f5845ca8a7ddeb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:51.581121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:51.583926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 561/1103] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:51 2022] GET /identity/v3/users/131f3cda03c448b784f5845ca8a7ddeb => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:51.593157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:51.696919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:51.703183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5572-b3ee-4464-875f-c1704c649b4b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:51.739097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:51.739718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:51.739994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:51.740264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:51.817024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:51.818395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:51.919768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:51.927036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 543/1104] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:51.932964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:52.031301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bdd62-1993-437f-8f89-9e540bb6d4c9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:52.064429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:52.065089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:52.065368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:52.065639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:52.066776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:52.068242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076d079-a930-4eba-8585-c192e9830f5e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:52.069880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 562/1105] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:59:51 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:52.076045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:52.175661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4a9e-c542-4714-9b4f-fd2216d59701 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:52.209328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:52.209936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:52.210213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:52.210481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:52.211255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=988619def44e4ae8890c8e103bd393e3, user.id=131f3cda03c448b784f5845ca8a7ddeb) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:52.211562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:52.213007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ed1ca-147f-4fa3-ad6f-9b9125bbc3e6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:52.218641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 544/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:52 2022] GET /identity/v3/role_assignments?user.id=131f3cda03c448b784f5845ca8a7ddeb&scope.project.id=988619def44e4ae8890c8e103bd393e3&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:54.289895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0098c8-e7a8-46d2-a956-81b8d7d9dd3f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:54.290444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0098c8-e7a8-46d2-a956-81b8d7d9dd3f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:54.290444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0098c8-e7a8-46d2-a956-81b8d7d9dd3f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:54.291750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 563/1107] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:54.296994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:54.297400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:54.299403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:54.316467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:54.317697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:54.373329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:54.386076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 545/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:59:54.414857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0098c8-e7a8-46d2-a956-81b8d7d9dd3f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:54.460764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:54.517861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0098c8-e7a8-46d2-a956-81b8d7d9dd3f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:54.551792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:54.552418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:54.552722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:54.552993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:54.554131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:54.555544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f7ba9-8d62-4ee1-9457-8ea4b8031948 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:54.557168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 564/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 05:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:54.563045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:54.668529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8015-fc8a-43bd-8f73-7ee7271fb8af None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:54.706168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:54.706780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:54.707055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:54.707321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:54.708258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:54.709710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c2c98-c78f-4b31-a4c0-8604a5bae127 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:54.730870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 546/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 05:59:54 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:59:56.808242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea429c9-8cef-4e23-917a-8e6ef7060c15 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:56.808913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea429c9-8cef-4e23-917a-8e6ef7060c15 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:56.808913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea429c9-8cef-4e23-917a-8e6ef7060c15 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:56.810157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 565/1111] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:56.815298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:56.815697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:56.815837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:56.834116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:56.835285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:56.876852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:56.903716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 547/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:56.931414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea429c9-8cef-4e23-917a-8e6ef7060c15 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:57.030547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea429c9-8cef-4e23-917a-8e6ef7060c15 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:57.041975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:57.065767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:57.066324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:57.066595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:57.066859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] PATH_INFO: `/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:57.068239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] RBAC: Authorizing `identity:get_role(role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:57.069681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:57.071001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 566/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:56 2022] GET /identity/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:57.077146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:57.174318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d9efa-f262-4574-a441-27c5dfc44bb4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:57.206691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:57.207347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:57.207624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:57.208147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] PATH_INFO: `/v3/users/837c826efb79402590e8c694d3fa585c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:57.221144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=837c826efb79402590e8c694d3fa585c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:57.222573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:57.224183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 548/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:57 2022] GET /identity/v3/users/837c826efb79402590e8c694d3fa585c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:57.230235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:57.325071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97920763-b36e-4bfb-b263-540075bb6c91 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:57.357880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:57.358486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:57.358763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:57.359030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:57.402757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:57.424804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:57.426247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:57.520010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 567/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 05:59:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:59:57.526179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:57.559012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:57.623810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf9ec-08de-4876-8e67-f351a6ae6cd0 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:57.656595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:57.658046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:57.658357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:57.658886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:57.659789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:57.661396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef640d01-623d-4f1f-a5f8-32b334d2dd5f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:57.663133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 549/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 05:59:57 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:57.669466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:59:57.745080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:59:57.766470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03886d-713c-490d-8357-d2b3c865e860 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:59:57.799423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:59:57.800017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:57.800291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:57.800557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:57.801346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=988619def44e4ae8890c8e103bd393e3, user.id=837c826efb79402590e8c694d3fa585c) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:59:57.801648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:59:57.803059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b81b3f-1d93-44db-9c3b-abcac350044c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:59:57.808170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 568/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 05:59:57 2022] GET /identity/v3/role_assignments?user.id=837c826efb79402590e8c694d3fa585c&scope.project.id=988619def44e4ae8890c8e103bd393e3&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:59:59.814102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804adb9-582a-4bf4-b3e0-ecdbce43b13c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:59.814688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804adb9-582a-4bf4-b3e0-ecdbce43b13c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:59.814688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804adb9-582a-4bf4-b3e0-ecdbce43b13c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:59.816017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 550/1118] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 05:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:59:59.821953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:59:59.822510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:59:59.822510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:59:59.842448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:59:59.843676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:59:59.912824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 569/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 05:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:59:59.935735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804adb9-582a-4bf4-b3e0-ecdbce43b13c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:00.042030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804adb9-582a-4bf4-b3e0-ecdbce43b13c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:00.043645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:00.079212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:00.079842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:00.080179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:00.080446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] PATH_INFO: `/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:00.082091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] RBAC: Authorizing `identity:get_role(role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:00.083715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:00.085109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 551/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 05:59:59 2022] GET /identity/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:00.090998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:00.166582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:00.196791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6453-0810-45f7-841f-bacdd5c3b85c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:00.230584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:00.231209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:00.231488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:00.231759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] PATH_INFO: `/v3/users/837c826efb79402590e8c694d3fa585c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:00.232912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] RBAC: Authorizing `identity:get_user(user_id=837c826efb79402590e8c694d3fa585c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:00.234324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:00.236463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 570/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:00 2022] GET /identity/v3/users/837c826efb79402590e8c694d3fa585c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:00.242301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:00.340244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11d1a-01c8-4b1a-85a9-0073e9705ace None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:00.372387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:00.373040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:00.373319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:00.373589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:00.374724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:00.376701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426475d-31f5-497a-99d2-b26db3d7fe1e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:00.378358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 552/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:00 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:00.384448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:00.488710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b69fd1-1fc8-4bc2-a488-c0bd86ccf164 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:00.530678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:00.531339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:00.531620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:00.532460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3/users/837c826efb79402590e8c694d3fa585c/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:00.534669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=988619def44e4ae8890c8e103bd393e3, user_id=837c826efb79402590e8c694d3fa585c, role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:00.536103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7292-46f3-45d5-ab1f-7a6fa3ccbac5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:00.545305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:00.551465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 571/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 06:00:00 2022] PUT /identity/v3/projects/988619def44e4ae8890c8e103bd393e3/users/837c826efb79402590e8c694d3fa585c/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:00:02.545859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c020-5d8b-4737-b2cf-da2adba70e2e None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:02.546397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c020-5d8b-4737-b2cf-da2adba70e2e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:02.546397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c020-5d8b-4737-b2cf-da2adba70e2e None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:02.547794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 553/1124] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:00:02.556598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:02.557280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:02.557280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:02.576730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:02.577924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:02.648662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 572/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:02.673425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c020-5d8b-4737-b2cf-da2adba70e2e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:02.717033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:02.779637 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c020-5d8b-4737-b2cf-da2adba70e2e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:02.814862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:02.815429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:02.815706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:02.815984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] PATH_INFO: `/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:02.817492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] RBAC: Authorizing `identity:get_role(role_id=5411f0bd6fbf47c4817d447d869c1fbc)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:02.818872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:02.820252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 554/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:02 2022] GET /identity/v3/roles/5411f0bd6fbf47c4817d447d869c1fbc => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:02.826382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:02.947940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065eca2-4bbc-4d0d-844b-ff097fedf440 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:02.979381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:02.987022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:02.987667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:02.987948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:02.988222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] PATH_INFO: `/v3/users/837c826efb79402590e8c694d3fa585c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:02.989416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] RBAC: Authorizing `identity:get_user(user_id=837c826efb79402590e8c694d3fa585c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:02.990844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:02.992466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 573/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:02 2022] GET /identity/v3/users/837c826efb79402590e8c694d3fa585c => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:02.999066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:03.105182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf739f-9e28-4b4f-b181-458db6701b2b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:03.114848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:03.144140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:03.144790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:03.145074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:03.145352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:03.213840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:03.215291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:03.318381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 555/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:03.324648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:03.425622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5b59a-c934-4557-8c01-759d2d5d2393 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:03.462444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:03.463080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:03.463355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:03.463622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] PATH_INFO: `/v3/projects/988619def44e4ae8890c8e103bd393e3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:03.464801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=988619def44e4ae8890c8e103bd393e3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:03.466231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae3e51-b1a7-4823-93e9-54b13530cfd0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:03.467893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 574/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:03 2022] GET /identity/v3/projects/988619def44e4ae8890c8e103bd393e3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:03.474160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:03.482424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:03.580033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fdb69-2e0d-4bce-afb7-620644ba848f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:03.616886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:03.617505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:03.617785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:03.618055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:03.618833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] RBAC: Adding query filter params (role.id=5411f0bd6fbf47c4817d447d869c1fbc, scope.project.id=988619def44e4ae8890c8e103bd393e3, user.id=837c826efb79402590e8c694d3fa585c) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:03.619140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:03.620572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa420-318a-4157-bb32-b4f711b455a3 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:03.628491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 556/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:00:03 2022] GET /identity/v3/role_assignments?user.id=837c826efb79402590e8c694d3fa585c&scope.project.id=988619def44e4ae8890c8e103bd393e3&role.id=5411f0bd6fbf47c4817d447d869c1fbc => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:05.670037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d5ce-eb8b-44c2-8291-cb42c5b35be5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:05.670588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d5ce-eb8b-44c2-8291-cb42c5b35be5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:05.670588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d5ce-eb8b-44c2-8291-cb42c5b35be5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:05.671930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 575/1131] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:05.680571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:05.681044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:05.681137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:05.699823 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:05.701039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:05.770518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:05.775435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 557/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:00:05.798495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983d5ce-eb8b-44c2-8291-cb42c5b35be5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:05.865506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:05.900753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983d5ce-eb8b-44c2-8291-cb42c5b35be5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:05.935585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:05.936142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:05.936419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:05.936714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:05.937870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:05.939836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5a750-c7dc-4a8e-9335-d5fe8d25beba None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:05.941454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 576/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:05.947298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:06.044774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5da7f2-d494-46cb-81c2-9ef9afe0f5c9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:06.078448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:06.079606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:06.079915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:06.080156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:06.080870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:06.082307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc4818-d966-44e5-8170-67ab85bd1f4b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:06.109180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 558/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 06:00:05 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:00:08.149531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c6de-cdc6-4f1d-a569-c5458aaec124 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:08.150124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c6de-cdc6-4f1d-a569-c5458aaec124 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:08.150124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4c6de-cdc6-4f1d-a569-c5458aaec124 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:08.151437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 577/1135] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:08.156913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:08.157342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:08.157457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:08.177405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:08.178573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:08.226422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:08.248313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 559/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:08.274419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c6de-cdc6-4f1d-a569-c5458aaec124 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:08.375987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4c6de-cdc6-4f1d-a569-c5458aaec124 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:08.411348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:08.411981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:08.412260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:08.412528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:08.413698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:08.415124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a9cd-b936-4b45-8bc5-4fe5b60653f6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:08.416746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 578/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:00:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:08.423585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:08.536669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae1041-5418-4384-95b7-220dd5987838 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:08.576035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:08.576690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:08.576972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:08.577249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:08.577939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:08.579448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec631-6cc6-47ac-b422-d6f37a9f4e8d None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:08.605359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 560/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 06:00:08 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:00:10.687441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bdfd-dfe4-4b4d-b594-5155bf4d1900 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:10.688000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bdfd-dfe4-4b4d-b594-5155bf4d1900 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:10.688000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bdfd-dfe4-4b4d-b594-5155bf4d1900 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:10.689382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 579/1139] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:10.695515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:10.695935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:10.696061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:10.714504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:10.715683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:10.745694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:10.784532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 561/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:10.808254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3bdfd-dfe4-4b4d-b594-5155bf4d1900 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:10.811260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:10.911585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3bdfd-dfe4-4b4d-b594-5155bf4d1900 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:10.951511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:10.952061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:10.952338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:10.952609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:10.963087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:10.968007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:10.969770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:10.971130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 580/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:10.975862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:11.086261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795891e-56be-452e-a2bb-e5382f87c797 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:11.122594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:11.123226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:11.123504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:11.123866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:11.124516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:11.124847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:11.126834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:11.135585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 562/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:11.142024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:11.204243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:11.249296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73c6c3-72f0-4d65-b4b6-27514084c225 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:11.283861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:11.284485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:11.284793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:11.285065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] PATH_INFO: `/v3/users/c5cba9124d4242b3a4b51679bc990e79` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:11.299139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] RBAC: Authorizing `identity:get_user(user_id=c5cba9124d4242b3a4b51679bc990e79)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:11.300570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:11.302253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 581/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:11 2022] GET /identity/v3/users/c5cba9124d4242b3a4b51679bc990e79 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:11.308319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:11.340883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:11.410729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004a69-194b-401f-b9df-02d24deccb8f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:11.443852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:11.444467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:11.444776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:11.445043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:11.511145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:11.512499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:11.540919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:11.609018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 563/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:11.615482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:11.712079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53e6fd-e4e2-4922-9453-7aa5edc46337 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:11.731238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:11.745737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:11.746366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:11.746642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:11.746908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] PATH_INFO: `/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:11.748025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] RBAC: Authorizing `identity:get_project(project_id=7ba6f75feff346c49f1f8d0c5112c9b1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:11.749468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9635-f69f-4751-b730-604d2c873124 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:11.751899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 582/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:11 2022] GET /identity/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:11.758089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:11.853847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813769e-ef57-4ee1-95d6-850b8b6c0224 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:11.883002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:11.889154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:11.889763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:11.890037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:11.890303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:11.891099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=7ba6f75feff346c49f1f8d0c5112c9b1, user.id=c5cba9124d4242b3a4b51679bc990e79) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:11.891402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:11.892832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077d3d9-7014-4b91-aa9f-d24cea3f94f7 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:11.898116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 564/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:00:11 2022] GET /identity/v3/role_assignments?user.id=c5cba9124d4242b3a4b51679bc990e79&scope.project.id=7ba6f75feff346c49f1f8d0c5112c9b1&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:13.895792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433bd5-da20-4fbd-847b-f1d9f0556ef7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:13.896372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433bd5-da20-4fbd-847b-f1d9f0556ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:13.896372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433bd5-da20-4fbd-847b-f1d9f0556ef7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:13.897698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 583/1147] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:13.902898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:13.903340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:13.903433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:13.921745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:13.923574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:13.989568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 565/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:14.011670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49433bd5-da20-4fbd-847b-f1d9f0556ef7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:14.121077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49433bd5-da20-4fbd-847b-f1d9f0556ef7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:14.154389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:14.154943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:14.155223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:14.155490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:14.165760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:14.170662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:14.171798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:14.173251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 584/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:14.178583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:14.277373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767a3e7-ea00-4b42-a5a0-e8b72abe107a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:14.301251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:14.313770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:14.314390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:14.314670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:14.314941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:14.315654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:14.315959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:14.317356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:14.325741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 566/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:14.332649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:14.392922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:14.448141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8032-5f11-417a-9bb9-b6fb5ae90a75 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:14.482087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:14.482711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:14.482984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:14.483250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] PATH_INFO: `/v3/users/c5cba9124d4242b3a4b51679bc990e79` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:14.484369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c5cba9124d4242b3a4b51679bc990e79)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:14.485850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:14.487462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 585/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:14 2022] GET /identity/v3/users/c5cba9124d4242b3a4b51679bc990e79 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:14.493855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:14.607121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d72ae-8e18-41a7-883f-64ddfad8e50f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:14.642863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:14.643505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:14.643783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:14.644056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] PATH_INFO: `/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:14.645234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7ba6f75feff346c49f1f8d0c5112c9b1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:14.646667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5526-6664-49b0-8649-e0eab7e788f9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:14.648331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 567/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:14 2022] GET /identity/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:14.654682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:14.760464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e54b9-2fd1-4793-8b0b-2d09d753a3a3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:14.779897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:14.800629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:14.801332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:14.801603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:14.801872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] PATH_INFO: `/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1/users/c5cba9124d4242b3a4b51679bc990e79/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:14.803810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba6f75feff346c49f1f8d0c5112c9b1, user_id=c5cba9124d4242b3a4b51679bc990e79, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:14.805322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c126c-1dea-4a12-bba6-ff17126c417a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:14.819597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 586/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 06:00:14 2022] PUT /identity/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1/users/c5cba9124d4242b3a4b51679bc990e79/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:00:16.848020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39237-85b7-439b-86ae-ab2d89179d0b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:16.848569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39237-85b7-439b-86ae-ab2d89179d0b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:16.848569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c39237-85b7-439b-86ae-ab2d89179d0b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:16.850000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 568/1154] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:16.855685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079910-2787-4244-ae3a-675f676107c8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:16.856182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079910-2787-4244-ae3a-675f676107c8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:16.856272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59079910-2787-4244-ae3a-675f676107c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:16.875387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-59079910-2787-4244-ae3a-675f676107c8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:16.876599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-59079910-2787-4244-ae3a-675f676107c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:16.947166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 587/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:16.971342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39237-85b7-439b-86ae-ab2d89179d0b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:17.028803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:17.084722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c39237-85b7-439b-86ae-ab2d89179d0b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:17.123922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:17.124479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:17.124796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:17.125643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:17.142030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:17.147175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:17.148294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:00:17.149513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 569/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:17.154627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59079910-2787-4244-ae3a-675f676107c8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:17.258513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59079910-2787-4244-ae3a-675f676107c8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:17.268306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:17.299006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:17.299611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:17.299884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:17.300149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:17.300945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:17.301271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:17.302611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:17.311159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 588/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:17.317461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:17.432529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f4aef-fe54-4305-99f4-9f7c5dc2dcfe None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:17.447680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:17.470699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:17.471340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:17.471622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:17.471898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] PATH_INFO: `/v3/users/c5cba9124d4242b3a4b51679bc990e79` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:17.473105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] RBAC: Authorizing `identity:get_user(user_id=c5cba9124d4242b3a4b51679bc990e79)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:17.474541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:17.476172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 570/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:17 2022] GET /identity/v3/users/c5cba9124d4242b3a4b51679bc990e79 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:17.482020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:17.585360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed4d72-ae36-4075-a4f3-1b37400141ab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:17.622152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:17.622766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:17.623044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:17.623313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:17.660324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:17.694341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:17.695693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:17.802343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 589/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:17.809297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:17.911978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307bd5-9fe1-40ff-bfa8-10ea7a896b29 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:17.947589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:17.948152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:17.948430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:17.948726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] PATH_INFO: `/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:17.949893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ba6f75feff346c49f1f8d0c5112c9b1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:17.951320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb6976-d0b7-4383-ba71-52a2b576b7e1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:17.953030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 571/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:17 2022] GET /identity/v3/projects/7ba6f75feff346c49f1f8d0c5112c9b1 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:17.960170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:18.029386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:18.072386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fe37a-63e3-4b38-8cad-a009e666e00d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:18.118582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:18.119539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:18.119936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:18.120320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:18.121677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=7ba6f75feff346c49f1f8d0c5112c9b1, user.id=c5cba9124d4242b3a4b51679bc990e79) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:18.122194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:18.124823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b0104-d937-4e3e-ae2a-86c12268bfeb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:18.131275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 590/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:00:17 2022] GET /identity/v3/role_assignments?user.id=c5cba9124d4242b3a4b51679bc990e79&scope.project.id=7ba6f75feff346c49f1f8d0c5112c9b1&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:20.260554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c96f-9503-45d6-a4b2-526bbc3a8add None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:20.261138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c96f-9503-45d6-a4b2-526bbc3a8add None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:20.261138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c96f-9503-45d6-a4b2-526bbc3a8add None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:20.262466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 572/1162] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:20.267966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:20.268386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:20.268505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:20.286744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:20.287913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:20.352989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 591/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:00:20.375616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c96f-9503-45d6-a4b2-526bbc3a8add None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:20.428724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:20.477720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c96f-9503-45d6-a4b2-526bbc3a8add None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:20.510973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:20.511586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:20.511857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:20.512123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:20.584029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:20.585485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:20.636747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:20.702281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 573/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:20.709740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:20.774738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:20.815447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688adaf5-1288-4ae9-b02b-3cc19ed639b7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:20.858449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:20.859080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:20.859398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:20.859683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:20.866294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:20.867731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ddeb225b-b111-4431-bee7-0958c3e9211f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:20.879907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:20.881423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:20.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 592/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 06:00:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:20.887584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:21.006791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b26e-d92e-4fc6-b8d3-83b1220af213 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:21.064331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:21.065406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:21.065897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:21.069175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:21.070471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:21.071009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:21.073597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da26f-aa17-4c34-8c09-ab7c4259ccea None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:21.085570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 574/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jul 28 06:00:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:23.124263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a5ee-4a2b-40a0-9588-caa2d85c215d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:23.125056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a5ee-4a2b-40a0-9588-caa2d85c215d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:23.125056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a5ee-4a2b-40a0-9588-caa2d85c215d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:23.126255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 593/1167] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:23.131625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252314cd-b01d-433a-83cd-ef3d1c52e734 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:23.132106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252314cd-b01d-433a-83cd-ef3d1c52e734 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:23.132207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252314cd-b01d-433a-83cd-ef3d1c52e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:23.150753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-252314cd-b01d-433a-83cd-ef3d1c52e734 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:23.151941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-252314cd-b01d-433a-83cd-ef3d1c52e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:23.162317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:23.223056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 575/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:00:23.246036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a5ee-4a2b-40a0-9588-caa2d85c215d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:23.357892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a5ee-4a2b-40a0-9588-caa2d85c215d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:23.389086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:23.401932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:23.402553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:23.402817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:23.403083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:23.403787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:23.405478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9f19-7d8a-4daf-aa80-849c12d2c6c3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:23.423438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 594/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Thu Jul 28 06:00:23 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:00:25.511963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4af0-e9df-4aad-b3a7-ec9c13ee694d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:25.512480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4af0-e9df-4aad-b3a7-ec9c13ee694d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:25.512480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e4af0-e9df-4aad-b3a7-ec9c13ee694d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:25.513976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 576/1170] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:25.519699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:25.520144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:25.520277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:25.538763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:25.539920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:25.621722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 595/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:00:25.644771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e4af0-e9df-4aad-b3a7-ec9c13ee694d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:25.747943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e4af0-e9df-4aad-b3a7-ec9c13ee694d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:25.783398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:25.784049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:25.784327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:25.784604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] PATH_INFO: `/v3/domains/de4ed2cfd7504d7fb09399b96fda680a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:25.796379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=de4ed2cfd7504d7fb09399b96fda680a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:25.797915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d063b0e-2d63-4b54-8b47-18f4e5348688 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:25.799606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 577/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Thu Jul 28 06:00:25 2022] GET /identity/v3/domains/de4ed2cfd7504d7fb09399b96fda680a => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:25.805800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:25.911046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5eb2-5695-4662-85d2-af6230073968 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:25.926237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:25.949799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:25.950418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:25.950692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:25.950954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:25.951638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:25.953794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b82d0-51b5-48d6-8406-b5b227b1e69e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:25.988613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 596/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 06:00:25 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:00:28.057355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4a22e-8113-409c-8cce-5708fb99393a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:28.057912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4a22e-8113-409c-8cce-5708fb99393a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:28.057912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4a22e-8113-409c-8cce-5708fb99393a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:28.059269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 578/1174] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:28.065102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:28.065532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:28.065639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:28.085720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:28.087616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:28.167247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 597/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:28.196073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4a22e-8113-409c-8cce-5708fb99393a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:28.199973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:28.304328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4a22e-8113-409c-8cce-5708fb99393a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:28.340916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:28.341478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:28.341759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:28.342034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] PATH_INFO: `/v3/domains/de4ed2cfd7504d7fb09399b96fda680a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:28.343185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=de4ed2cfd7504d7fb09399b96fda680a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:28.345218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa1908-3aec-490e-8445-5ab7e24971a4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:28.346819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 579/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Thu Jul 28 06:00:28 2022] GET /identity/v3/domains/de4ed2cfd7504d7fb09399b96fda680a => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:28.353012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:28.444247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:28.453702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab803f6-d2d4-4a12-8218-d7f581b25582 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:28.507007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:28.507620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:28.507896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:28.508164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:28.508877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:28.510301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1cb9-39c7-42fb-9107-b922af899c05 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:28.535951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 598/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 06:00:28 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:00:30.639254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1d92-d379-4605-8089-cce511b27a8a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:30.639835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1d92-d379-4605-8089-cce511b27a8a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:30.639835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1d92-d379-4605-8089-cce511b27a8a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:30.641712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 580/1178] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:30.648695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:30.649130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:30.649254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:30.668595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:30.669819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:30.742948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 599/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:30.767200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1d92-d379-4605-8089-cce511b27a8a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:30.855266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:30.887111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1d92-d379-4605-8089-cce511b27a8a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:30.923001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:30.923542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:30.923835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:30.924105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:30.936782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:30.942243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:30.943293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:00:30.944417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 581/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:30.949696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:31.048694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:31.074530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1223a-9041-42e2-9963-d6644c0d4dd2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:31.115133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:31.115743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:31.116018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:31.116284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:31.117013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:31.117311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:31.118682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:31.127521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 600/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:31.134544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:31.257508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c080-7018-480f-9f32-1104e615415b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:31.298617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:31.307645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:31.308355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:31.308632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:31.308935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] PATH_INFO: `/v3/users/8360929c8cd040f0b079c346d2045ed1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:31.323380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] RBAC: Authorizing `identity:get_user(user_id=8360929c8cd040f0b079c346d2045ed1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:31.324861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:31.326542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 582/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:31 2022] GET /identity/v3/users/8360929c8cd040f0b079c346d2045ed1 => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:31.332444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:31.435881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802e575-99ba-493f-802d-f07d488c18ac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:31.479366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:31.479974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:31.480245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:31.480512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:31.493027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:31.550968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:31.552403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:31.653070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 601/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:31.659531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:31.763696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32eb7b-3da3-49e1-b21d-23fccf7da916 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:31.798282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:31.798958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:31.799238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:31.799512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] PATH_INFO: `/v3/projects/5fda8c441f1748b69708f966bc9d2b0c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:31.800684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] RBAC: Authorizing `identity:get_project(project_id=5fda8c441f1748b69708f966bc9d2b0c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:31.802170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06079-4b4e-4d40-b590-dbc1a8a72f0a None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:31.803789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 583/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:31 2022] GET /identity/v3/projects/5fda8c441f1748b69708f966bc9d2b0c => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:31.811144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:31.863492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:31.926033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e58b-0a95-4086-9137-9623e886a480 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:31.968248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:31.969499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:31.969774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:31.970043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:31.970821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=5fda8c441f1748b69708f966bc9d2b0c, user.id=8360929c8cd040f0b079c346d2045ed1) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:31.971121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:31.972538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9812f-4ea8-4f3d-b76c-487f359f8a09 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:31.978057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 602/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:00:31 2022] GET /identity/v3/role_assignments?user.id=8360929c8cd040f0b079c346d2045ed1&scope.project.id=5fda8c441f1748b69708f966bc9d2b0c&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:34.019247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b04bab-3517-4179-b065-9bbfa4891f2a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.019929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b04bab-3517-4179-b065-9bbfa4891f2a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.019929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b04bab-3517-4179-b065-9bbfa4891f2a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.021304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 584/1186] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:00:34.026995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.027465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.027593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.047483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:34.048732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:34.120408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 603/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:00:34.143933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b04bab-3517-4179-b065-9bbfa4891f2a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:34.217326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:34.269574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b04bab-3517-4179-b065-9bbfa4891f2a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:34.310740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:34.311401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.311681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.311989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.326504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:34.334131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:34.335967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:00:34.337739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 585/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:34.348052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:34.402879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:34.493239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d451-f7f5-404c-8da2-add2c6f1b919 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:34.535561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:34.536180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.536465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.536764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.537474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:34.537770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:34.539124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:34.547807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 604/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:34.554262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:34.659064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c971c-b543-4132-b1d8-170b25591b3b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:34.677287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:34.695878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:34.696526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.696831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.697106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] PATH_INFO: `/v3/users/8360929c8cd040f0b079c346d2045ed1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.698259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] RBAC: Authorizing `identity:get_user(user_id=8360929c8cd040f0b079c346d2045ed1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:34.699697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:34.701329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 586/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:34 2022] GET /identity/v3/users/8360929c8cd040f0b079c346d2045ed1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:34.708956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:34.811763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:34.815840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0091fa-3278-47eb-9af5-9953bc319a6d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:34.865325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:34.866364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:34.866695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:34.866926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] PATH_INFO: `/v3/projects/5fda8c441f1748b69708f966bc9d2b0c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:34.868141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] RBAC: Authorizing `identity:get_project(project_id=5fda8c441f1748b69708f966bc9d2b0c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:34.869610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5f2f-1903-4454-82a9-f5d25cd82a34 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:34.871284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 605/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:34 2022] GET /identity/v3/projects/5fda8c441f1748b69708f966bc9d2b0c => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:34.877748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:34.981833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0807e6-5115-47d5-9595-2abd664e4a3f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:35.019390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:35.020046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:35.020325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:35.020591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] PATH_INFO: `/v3/projects/5fda8c441f1748b69708f966bc9d2b0c/users/8360929c8cd040f0b079c346d2045ed1/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:35.022534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fda8c441f1748b69708f966bc9d2b0c, user_id=8360929c8cd040f0b079c346d2045ed1, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:35.023962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4b6f3-d98a-48b1-98ad-613dfdfd2de4 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:35.038246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 587/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 06:00:34 2022] PUT /identity/v3/projects/5fda8c441f1748b69708f966bc9d2b0c/users/8360929c8cd040f0b079c346d2045ed1/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:00:37.077797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33fff9-6ac1-4148-bade-723ebbbf826e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.078382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33fff9-6ac1-4148-bade-723ebbbf826e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.078382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33fff9-6ac1-4148-bade-723ebbbf826e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.079723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 606/1193] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:00:37.087592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.088137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.088462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.116592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:00:37.117808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:00:37.165604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:37.194220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 588/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:00:37.218924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33fff9-6ac1-4148-bade-723ebbbf826e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:37.336986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33fff9-6ac1-4148-bade-723ebbbf826e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:37.373294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:37.373940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.374215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.374514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.385491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:00:37.390963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:00:37.392128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:00:37.393210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 607/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:00:37.398484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:37.515585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c49ba-014e-445d-93e5-0c5f742e046a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:37.549915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:37.550537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.550816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.551087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.551798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:37.552099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:37.553496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:37.562572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 589/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:37.568667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:37.598176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:37.676048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e193-4d66-4654-b076-6bd3ab506185 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:37.713550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:37.714499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.714659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.714946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] PATH_INFO: `/v3/users/8360929c8cd040f0b079c346d2045ed1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.716184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] RBAC: Authorizing `identity:get_user(user_id=8360929c8cd040f0b079c346d2045ed1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:37.717660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:37.719312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 608/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jul 28 06:00:37 2022] GET /identity/v3/users/8360929c8cd040f0b079c346d2045ed1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:37.725217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:37.768671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:37.830837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d787f-f7d2-488a-be93-5c0176d8b290 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:37.866705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:37.867242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:37.867518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:37.867782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:37.956502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:37.958263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:37.998369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:38.071231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 590/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:00:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:00:38.078038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:38.196924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:38.204422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72125-4486-49c5-b052-6e786a259acc None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:38.242839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:38.243479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:38.243757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:38.244026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] PATH_INFO: `/v3/projects/5fda8c441f1748b69708f966bc9d2b0c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:38.245288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] RBAC: Authorizing `identity:get_project(project_id=5fda8c441f1748b69708f966bc9d2b0c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:38.246816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460aa7a1-40e8-4536-96f0-a0b0d6d9ab0d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:38.248552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 609/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jul 28 06:00:38 2022] GET /identity/v3/projects/5fda8c441f1748b69708f966bc9d2b0c => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:00:38.257977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:00:38.381449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585e2a-a5f0-451d-8054-85777278e8ec None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:00:38.415562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:00:38.416170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:00:38.416444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:00:38.416758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:00:38.417606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=5fda8c441f1748b69708f966bc9d2b0c, user.id=8360929c8cd040f0b079c346d2045ed1) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:00:38.417913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:00:38.419419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436ab4-4ae0-412e-a844-a7c6dbb4bdfb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:00:38.425960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 591/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:00:38 2022] GET /identity/v3/role_assignments?user.id=8360929c8cd040f0b079c346d2045ed1&scope.project.id=5fda8c441f1748b69708f966bc9d2b0c&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:00:48.238628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=19 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:00:48.423355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:34.784877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002871-af59-46ee-90c1-9bbc1efdfc01 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:34.785467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002871-af59-46ee-90c1-9bbc1efdfc01 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:34.785467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002871-af59-46ee-90c1-9bbc1efdfc01 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:34.787160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 610/1201] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:34.793455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:34.794661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:34.795190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:34.817307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:34.818657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:34.908589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 592/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:34.930268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002871-af59-46ee-90c1-9bbc1efdfc01 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:35.058663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002871-af59-46ee-90c1-9bbc1efdfc01 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:35.101047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:35.101698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:35.101993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:35.102241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:35.114850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:35.116325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:35.134365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:35.135532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:35.136511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:35.136511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:35.136511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:35.136511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:35.136511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 611/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:35.142548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:35.312782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40a1fa-7eb0-4b7c-9840-8e0be878a1f1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:35.356129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:35.364085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:35.364746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:35.365088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:35.365311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:35.366047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:35.366336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:35.367833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71db36-da40-4ced-a55a-3b4fe1152050 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:35.387555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 593/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:01:35.388896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:35.464320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:35.530279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110744-7273-4d38-9124-c84d28050b8d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:35.571851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:35.572693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:35.573170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:35.573689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:35.578032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:35.578032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3350-2f4f-4833-910e-c61516fe469a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:35.607794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 612/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jul 28 06:01:35 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:01:38.021552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bab73-39b3-485e-b868-27ce7b932bae None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.022106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bab73-39b3-485e-b868-27ce7b932bae None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.022106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bab73-39b3-485e-b868-27ce7b932bae None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.023480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 594/1206] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:38.028899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255276d-975d-4c04-a958-a79f5065358e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.029499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255276d-975d-4c04-a958-a79f5065358e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.029499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255276d-975d-4c04-a958-a79f5065358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.053740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e255276d-975d-4c04-a958-a79f5065358e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:38.054954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e255276d-975d-4c04-a958-a79f5065358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:38.143575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 613/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:38.167248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bab73-39b3-485e-b868-27ce7b932bae None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:38.297960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bab73-39b3-485e-b868-27ce7b932bae None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:38.351806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:38.351806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.351806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.351806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.368941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:01:38.374960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:38.376610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:38.381837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 595/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 06:01:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:38.383887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255276d-975d-4c04-a958-a79f5065358e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:38.430172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:38.507474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255276d-975d-4c04-a958-a79f5065358e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:38.555506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:38.556160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.556489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.556857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.557602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:38.557862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:38.559233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:38.569815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 614/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 06:01:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:38.575628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:38.632231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:38.693906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf6db-69e0-44b6-b62e-cfc1e4610858 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:38.738824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:38.739502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.739782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.740057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.752228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:38.753947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:38.769783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:38.771023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:38.772116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:38.772116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:38.772116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:38.772116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:38.776918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 596/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:38.778455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:38.891121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:38.894065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50875c6-f800-4712-9fcf-d34058417437 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:38.936765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:38.937387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:38.937705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:38.938019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:38.938807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:38.939164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:38.940563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:38.954881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 615/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:38.960866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:39.076848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6062f-fad7-41e6-b4b5-96a3a277eb9e None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:39.079160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:39.115383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:39.116047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:39.116319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:39.116587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:39.125582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:39.127465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:01:39.139770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:39.141842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:39.143284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 597/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:39.147456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:39.262261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b733eb4-b90d-4b44-ac5e-26e6f33404f6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:39.299093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:39.299710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:39.299990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:39.300257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:39.301085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:39.301432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:39.302808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:39.321182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 616/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:01:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:39.327284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:39.444344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b485-90fe-49c3-bdfc-a691fc9d13df None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:39.485521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:39.486478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:39.486762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:39.487064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:39.524950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:39.575723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:39.577406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:39.716816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 598/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:01:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 06:01:39.722787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:39.745898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:39.838964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048f025-7c1b-4c06-ac6a-8c968b028043 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:39.882507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:39.883216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:39.883609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:39.883760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:39.894604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:39.896369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:39.912414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:39.913386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:39.914466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:39.914466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:39.914466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:39.914466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:39.916518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 617/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:39.922968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:39.992500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:40.038261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e458f3-f726-465f-8779-2d2bad5c566f None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:40.075347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:40.075974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:40.076273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:40.079588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:40.079588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:40.079588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:40.080240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:40.092331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 599/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:40.100823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:40.180259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:40.215717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612ada-5cdf-46f2-8a1c-48251cb31e1a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:40.253023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:40.253638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:40.253918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:40.254188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:40.261614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:40.263261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:01:40.275948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:40.276945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:40.278510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 618/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:40.283911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:40.401034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43076d6-6d18-4822-9004-40f60319cd95 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:40.429502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:40.443955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:40.444748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:40.444981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:40.445347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:40.446108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:40.446416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:40.448006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db325185-9845-4c5f-ac69-f28099e5faa9 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:40.460533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 600/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:01:40.466636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:40.585735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e629a-e034-4166-8fb3-396b5f4ae135 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:40.623747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:40.631115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:40.631941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:40.632297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:40.632683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:40.633479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=3d15a61438b44de4bb2625f3b3b1622f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:40.633794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:40.635367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aa081-8a9d-48a7-a757-e36631f600e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:40.642244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 619/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:01:40 2022] GET /identity/v3/role_assignments?user.id=3d15a61438b44de4bb2625f3b3b1622f&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:42.762873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c497fb-ad1f-45f0-87b6-b4a6e24caa6b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:42.763433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c497fb-ad1f-45f0-87b6-b4a6e24caa6b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:42.763540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c497fb-ad1f-45f0-87b6-b4a6e24caa6b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:42.765137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 601/1220] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:42.770961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:42.771401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:42.771513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:42.793303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:42.794643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:42.873837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 620/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:42.898050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c497fb-ad1f-45f0-87b6-b4a6e24caa6b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.014828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c497fb-ad1f-45f0-87b6-b4a6e24caa6b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.061360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.062053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.062341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.062736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.074366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:01:43.080440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:43.081515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:43.082744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 602/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 06:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:43.088320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.194645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d5130-5a9c-4ca2-a3f7-5ee90ad347c3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.218321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:43.230155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.230777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.231132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.231402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.232136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:43.232456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:43.233937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:43.243010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 621/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:01:43.249464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.297607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:43.358012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40958-fea8-4981-83e5-688383771338 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.395077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.395717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.395996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.396267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.406119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:43.408111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:43.424296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:43.425405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:43.426401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:43.426401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:43.426401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:43.426401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:43.426401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 603/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:43.431991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.539490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aae8ad-45d5-4a5f-afbd-36628f5828f1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.575096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.575656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.575930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.576203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.576912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:43.577218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:43.579151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:43.592202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 622/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:43.598969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.706556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:43.715440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799e11-df0e-4c3e-bcc1-569ea97b7ff2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.751938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.752557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.752869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.753141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.760791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:43.762262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:01:43.774324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:43.775951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:43.777329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 604/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:43.781949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:43.835955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:43.892253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0910e0-dea5-43c6-852b-36bc55fac5a8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:43.930457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:43.931075 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:43.931349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:43.931617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:43.932402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:43.932739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:43.934154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:43.951810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 623/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:43.958410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:44.067705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeef59-d960-4533-8ef7-27379504dd88 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:44.106661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:44.107345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:44.107624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:44.107896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:44.119501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:44.121082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:44.136278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:44.137433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:44.138377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:44.138377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:44.138377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:44.138377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:44.138377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 605/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:44.143982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:44.258173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1119-d83f-4b20-9e9d-0cdd74aec422 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:44.261105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:44.295595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:44.296224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:44.296502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:44.297330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:44.298134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:44.298536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:44.300182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:44.313485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 624/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:44.319770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:44.330188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:44.432371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324af6e-a470-4552-bcd1-782b04cf5454 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:44.470450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:44.471097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:44.471374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:44.471647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:44.478549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:44.480083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:01:44.494201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:44.495175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:44.496083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 606/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:44.502365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:44.612065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534740ad-0b70-4222-8e41-3375b7de553a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:44.651282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:44.651970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:44.652251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:44.652526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:44.653393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:44.653704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:44.655220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a5cf5-1e71-4993-9b10-b99b39d51d2d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:44.668307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 625/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:44.675306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:44.754653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:44.793287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fb3d1-f747-437e-b829-f758ae92a1cb None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:44.828885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:44.829560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:44.829841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:44.830117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/3d15a61438b44de4bb2625f3b3b1622f/roles/685131b692074d41a77a1302375ef4c9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:44.845711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=3d15a61438b44de4bb2625f3b3b1622f, role_id=685131b692074d41a77a1302375ef4c9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:44.847144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be850d-594f-4904-a0f7-6121f13a8477 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:44.861177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 607/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 06:01:44 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/3d15a61438b44de4bb2625f3b3b1622f/roles/685131b692074d41a77a1302375ef4c9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:01:46.949027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402c64-f21b-45c1-a2a7-5a014b60d15a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:46.949602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402c64-f21b-45c1-a2a7-5a014b60d15a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:46.949602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402c64-f21b-45c1-a2a7-5a014b60d15a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:46.950946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 626/1233] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:46.956130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:46.956555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:46.956690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:46.976976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:46.978186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:47.055721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 608/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:47.093304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402c64-f21b-45c1-a2a7-5a014b60d15a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:47.120253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:47.204092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402c64-f21b-45c1-a2a7-5a014b60d15a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:47.243932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:47.244848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:47.245196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:47.245433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:47.257353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:01:47.263454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:47.264693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 06:01:47.265798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:47.270707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 627/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:47.271834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:47.320345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:47.374822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9b47-401f-4f40-bfd4-9b8684e0a171 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:47.411677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:47.412305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:47.412578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:47.412917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:47.413634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] RBAC: Adding query filter params (name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:47.413967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:47.415476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:47.424624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 609/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:47.430923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:47.538022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:47.554669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a286c-ca0d-4e11-b5d0-76b7af3fd764 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:47.593284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:47.594805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:47.595242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:47.595674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:47.606185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:47.607744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:47.623683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:47.625028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:47.625955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:47.625955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:47.625955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:47.625955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:47.625955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 628/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:47.630806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:47.743568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db643fd5-cf51-431c-be99-39e2a99da71b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:47.753738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:47.781249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:47.782133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:47.782418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:47.782790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:47.783718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:47.784164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:47.786787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:47.799744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 610/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:47.805802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:47.920516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2945a-fb59-466f-9795-8fbeffac0d12 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:47.957347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:47.958291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:47.958510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:47.958780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:47.961613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:47.967364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:47.969086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:01:47.980283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:47.981677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:47.982882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 629/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:47.987477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:48.095365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5807f-875a-4e6c-b74b-63d384c0d80b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:48.132024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:48.132811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:48.133094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:48.133366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:48.134192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:48.134496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:48.136069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:48.155019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 611/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:01:48.161459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:48.273773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e71877-3117-43c8-82dd-8ce5e52c48ab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:48.311268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:48.312003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:48.312283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:48.313161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:48.383119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:48.391819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:48.393602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:48.495898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 630/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:01:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:01:48.502256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:48.534285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:48.618760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bc44b-5b68-4d8a-ac97-b2aa66584183 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:48.657157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:48.657737 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:48.658018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:48.658287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:48.668773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:48.670227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:48.687660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:48.689189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:48.690349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:48.690349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:48.690349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:48.690349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:48.690349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 612/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:48.694865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:48.800616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:48.806686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5026-f831-4efd-88f9-d0d022771935 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:48.843052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:48.844323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:48.844605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:48.844910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:48.845590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:48.845887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:48.847240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:48.858425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 631/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:48.864295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:48.949511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:48.975045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338e5b-b6d2-4882-b97f-2e90111b8a5c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:49.010687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:49.011413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:49.011677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:49.012004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:49.020192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:49.021688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:01:49.033994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:49.039896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:49.041063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 613/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:49.041633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:49.154660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa14e9-997b-4530-b019-5dc9378cbb8a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:49.193068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:49.193903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:49.194256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:49.194531 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:49.195411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:49.195754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:49.197447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a953f3b-253e-4b76-85fb-3e244122fb26 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:49.216661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 632/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:01:49.217997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:49.327209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bcf7f-899d-4114-893f-20dac68d7cb2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:49.361838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:49.362453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:49.362730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:49.362994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:49.363765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] RBAC: Adding query filter params (role.id=685131b692074d41a77a1302375ef4c9, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=3d15a61438b44de4bb2625f3b3b1622f) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:49.364067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:49.365539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148cb8f-2f7f-4122-a2bc-00fe4d503c2e None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:49.371332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 614/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:01:49 2022] GET /identity/v3/role_assignments?user.id=3d15a61438b44de4bb2625f3b3b1622f&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=685131b692074d41a77a1302375ef4c9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:51.553637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f55b0-c282-4744-b06d-7273fc4aeb06 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:51.554236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f55b0-c282-4744-b06d-7273fc4aeb06 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:51.554353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f55b0-c282-4744-b06d-7273fc4aeb06 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:51.555985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 633/1247] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:51.561834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:51.562289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:51.562475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:51.569419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:51.583929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:51.585258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:51.658839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 615/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:51.682470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f55b0-c282-4744-b06d-7273fc4aeb06 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:51.707817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:51.803291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f55b0-c282-4744-b06d-7273fc4aeb06 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:51.845104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:51.845700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:51.845945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:51.846255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:51.857850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:01:51.863002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:51.864245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:51.865590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 634/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:51.870561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:51.985656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224df34-359a-4089-8cf4-fcbde09a1d41 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.018781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:52.024526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.025386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.025756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.026027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:52.026947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:52.027294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:52.028914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:52.038553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 616/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:52.044399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:52.138911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:52.163187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe4672-53f0-4168-8762-7e6ef2a62242 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.202512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.203266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.203541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.203802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:52.215646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:52.217314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:52.232542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:52.233560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:52.235081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:52.235081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:52.235081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:52.235081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:52.235081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 635/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:52.240509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:52.355572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f09e-3dc5-46d5-801b-648b025ab1a6 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.391982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.392779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.393102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.393432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:52.394275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:52.394586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:52.396117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:52.408998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 617/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:52.414951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:52.525108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a60ef-e090-4724-bd95-c2d449446158 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.557094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:52.565809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.566461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.566783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.567007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:52.574970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:52.576403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:01:52.590183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:52.591212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:52.592187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 636/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:52.598180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:52.660956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:52.708590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37946528-998d-4506-ac3c-312218cb24bc None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.750402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.751116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.751408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.751802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:52.752610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:52.752966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:52.754397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:52.773242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 618/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:01:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:52.779094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:52.891539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3b46a-8fa6-4326-9fe7-696c2e5a7ed9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:52.935237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:52.935890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:52.936217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:52.936797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:53.004597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:53.020171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:53.021669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:53.138971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 637/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:01:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:01:53.140101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:53.252810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144f63d-feaa-47c3-a8dd-0cb965c2476c None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:53.267504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:53.290869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:53.293068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:53.293068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:53.293068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:53.304060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:53.305536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:53.319753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:53.320948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:53.321889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:53.321889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:53.321889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:53.321889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:53.321889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 619/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:53.329018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:53.423415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:53.439682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af2f8-6fa0-44ac-bcf2-8c82988dd4a8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:53.480579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:53.481217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:53.481495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:53.481762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:53.482442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:53.482742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:53.484738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:53.500689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 638/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:53.502886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:53.617774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcbbf-af5b-42e3-a941-d533b6de2a61 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:53.655427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:53.656127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:53.656447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:53.656712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:53.663699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:53.667029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:01:53.680867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:53.681807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:01:53.682747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 620/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:53.689971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:53.805892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8fb6-a4fe-4854-8ba0-f9ab7a3b4be0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:53.840172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:53.840820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:53.841103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:53.841374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:53.842114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:53.842488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:53.844336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c151c-fc94-4f25-b2b0-d9a9af3585d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:53.856536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 639/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:53.863626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:53.889708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:53.969020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0a521-d439-4bd7-9470-4364659a1f40 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:54.004816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:54.005448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:54.005723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:54.005995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:54.006795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=3d15a61438b44de4bb2625f3b3b1622f) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:54.007086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:54.008510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646bb00-c419-454a-b2ae-a68bc2bf4104 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:54.014204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 621/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:01:53 2022] GET /identity/v3/role_assignments?user.id=3d15a61438b44de4bb2625f3b3b1622f&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:56.015238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ffe4-c4c9-4ff3-8ffe-1a71f8937f84 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.015805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ffe4-c4c9-4ff3-8ffe-1a71f8937f84 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.015805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6ffe4-c4c9-4ff3-8ffe-1a71f8937f84 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.017154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 640/1261] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:56.022282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.022653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.022832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.041022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:56.042204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:56.107449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 622/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:01:56.129731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6ffe4-c4c9-4ff3-8ffe-1a71f8937f84 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:56.140328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:56.229237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6ffe4-c4c9-4ff3-8ffe-1a71f8937f84 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:56.261800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:56.262430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.262710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.262982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.272884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:01:56.277655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:56.278763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:56.279991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 641/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:56.286710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:56.306463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:56.384814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54777-f544-4ea7-81ad-e5b7c18d5b4a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:56.417816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:56.418425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.418703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.418974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.419676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:56.419979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:56.421373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:56.429137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 623/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:56.435005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:56.503115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:56.536402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d31a4-baf3-4ac5-a919-b467b2886ed7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:56.568733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:56.569361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.569641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.569906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.580112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:56.581576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:56.596511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:56.597422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:56.598342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:56.598342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:56.598342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:56.598342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:56.598342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 642/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:56.603545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:56.683816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:56.706242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffeb5b-813d-4e0a-a2fa-899d8eb07794 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:56.747496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:56.748145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.748422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.748725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.750039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:56.750459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:56.752040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:56.765292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 624/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:56.771495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:56.869613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a5fe-f8e4-4d69-9881-c1a26db0fe64 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:56.889378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:56.903837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:56.904460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:56.904767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:56.905035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:56.912990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:56.914410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:01:56.925591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:56.926728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:56.927906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 643/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:56.932575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.030407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d32a-cf3a-4d70-8b58-10b1f1f418fa None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.063725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.064332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.064605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.064903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.065671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:57.065972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.067373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.075696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:57.084461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 625/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:01:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:57.090171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.190098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881d23-12de-4a5d-a359-608183c73f1a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.225001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.225639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.225915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.226189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.237458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.238909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:01:57.254904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:57.256043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:57.257215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:01:57.257215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:01:57.257215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:01:57.257215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:57.257215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 644/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:57.261915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.365265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb66-4183-49b2-8726-75260f29ceb2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.398989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.399607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.399887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.400158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.400872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:57.401174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.402539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.413477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 626/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:57.419315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.451126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:57.519461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1ddcb-ed0d-4c49-8a43-1122c411dda2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.552901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.553533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.553811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.554081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.560679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.562159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:01:57.573165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:01:57.574271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:01:57.575352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 645/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:01:57.580163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.638551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:57.682409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b53ab-c9e1-405d-b2fd-139fee568e28 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.720306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.720944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.721287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.721528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.722383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:01:57.722730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.724377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608ffa-f1d5-4da9-8e15-c9fa2c2b332c None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.739074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 627/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:01:57.745117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:01:57.840164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:01:57.850206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72b95c-5fb1-4d67-ae2e-dbbe33184b31 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:01:57.882867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:01:57.883527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:57.883812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:57.884084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] PATH_INFO: `/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/3d15a61438b44de4bb2625f3b3b1622f/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:57.886021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8acce27c719462bbd65f2b683bbc913, user_id=3d15a61438b44de4bb2625f3b3b1622f, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:01:57.887450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a89a22-6458-44a6-a599-7e7876ad1083 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:01:57.900213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 646/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jul 28 06:01:57 2022] PUT /identity/v3/projects/f8acce27c719462bbd65f2b683bbc913/users/3d15a61438b44de4bb2625f3b3b1622f/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:01:59.890939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c53e5-4202-420f-af13-ba0a97d6c438 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:59.891472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c53e5-4202-420f-af13-ba0a97d6c438 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:59.891472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c53e5-4202-420f-af13-ba0a97d6c438 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:59.892881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 628/1274] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:01:59.897980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:01:59.898395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:01:59.898526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:01:59.916186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:01:59.917396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:01:59.982229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 647/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:01:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:02:00.005359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c53e5-4202-420f-af13-ba0a97d6c438 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.105498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c53e5-4202-420f-af13-ba0a97d6c438 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.124142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:00.142000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.142577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.142857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.143123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.153058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 06:02:00.158046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:00.159242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:00.160296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 629/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:00.165341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.244086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:00.262697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8d0c5-cb94-49a9-b02c-4ea6cec8a010 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.295284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.295880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.296153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.296977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.297669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:00.297965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:00.299307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:00.307033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 648/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:00.313353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.415353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2d480-24b4-49a1-a439-70c3eb697a6a None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.447861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.448491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.448801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.449073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.459570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:00.461079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:02:00.475213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:00.476225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:00.477545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:02:00.477545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:02:00.477545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:02:00.477545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:00.477545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 630/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:00.482141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.581257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73f15-21bd-47be-85cf-839c8ed6834a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.615890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.616494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.616809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.617081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.617755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:00.618057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:00.619405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:00.630758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 649/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:00.636469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.666673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:00.743279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a10bd2-e804-4ca1-aedf-180979ddee86 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.778172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.778818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.779091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.779357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.788063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:00.789528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 06:02:00.801709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:00.802999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:00.804186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 631/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:00.808850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:00.813214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:00.914765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1caf-ebfb-4969-b990-491304f10753 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:00.950312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:00.950842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:00.951121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:00.951387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:00.952176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:00.952548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:00.954006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:00.972673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 650/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:00.978437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:01.068797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:01.081614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0952-36d6-4c6b-8bfa-7888e7432bab None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:01.117523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:01.118151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:01.118430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:01.118702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:01.186827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:01.188845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:01.279638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:01.290773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 632/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jul 28 06:02:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 06:02:01.298247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:01.363826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:01.401229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ea1c-0b1c-413d-b121-4cb03f8c1a33 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:01.433914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:01.434538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:01.434815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:01.435084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:01.445372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:01.446801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 06:02:01.461902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:01.462984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:01.464045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 06:02:01.464045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 06:02:01.464045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 06:02:01.464045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:02:01.464045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 651/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:01.468826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:01.565488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d968-1f35-4d7c-a658-4ad0442bd33b None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:01.598176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:01.598779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:01.599056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:01.599326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:01.600002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:01.600302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:01.601704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:01.617265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 633/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jul 28 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:01.622946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:01.729257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3290dc8-b1d5-4335-81fa-96d808400f75 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:01.743073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:01.763344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:01.763975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:01.764254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:01.764520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:01.771022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:01.772458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 06:02:01.784343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:01.785424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jul 28 06:02:01.786534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 652/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jul 28 06:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:01.791344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:01.840484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:01.893235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865d54-1109-45a3-ac86-bde5720a18e1 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:01.925918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:01.926525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:01.926804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:01.927076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:01.927820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:01.928125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:01.929730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbcc4-3d84-4a28-8edd-9a9d4934af80 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:01.941915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 634/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jul 28 06:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:01.947918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:02.048885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d3f62-337f-425e-b8c0-551f06a185b3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:02.080931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:02.081537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:02.081814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:02.082080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:02.083116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] RBAC: Adding query filter params (role.id=3cf212a578ac4df6b651c27b6cfdbac8, scope.project.id=f8acce27c719462bbd65f2b683bbc913, user.id=3d15a61438b44de4bb2625f3b3b1622f) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:02.083424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:02.084868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864cdc-2207-476e-a7a5-41214f761302 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:02.090694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 653/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jul 28 06:02:01 2022] GET /identity/v3/role_assignments?user.id=3d15a61438b44de4bb2625f3b3b1622f&scope.project.id=f8acce27c719462bbd65f2b683bbc913&role.id=3cf212a578ac4df6b651c27b6cfdbac8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:04.114046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe872b9-4768-4b94-955a-fa84d99e58e9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:04.114494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe872b9-4768-4b94-955a-fa84d99e58e9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:04.114603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe872b9-4768-4b94-955a-fa84d99e58e9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:04.115957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 635/1288] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:02:04.121105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:04.121487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:04.121651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:04.139690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:02:04.141414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:02:04.169949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:04.207160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 654/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:02:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:02:04.228824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe872b9-4768-4b94-955a-fa84d99e58e9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:04.329766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe872b9-4768-4b94-955a-fa84d99e58e9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:04.340501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:04.364074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:04.364959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:04.365440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:04.365929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:04.366682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:04.368055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:04.377716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:04.378972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:04.379851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 636/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 06:02:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 06:02:04.385051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:04.479447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c931d7-0c0b-4988-aae8-c0fa9e8a6b66 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:04.512154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:04.512791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:04.513069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:04.513336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:04.513992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:04.514290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:04.516232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994530a6-3690-40ff-a6fd-1cfa5feb3e54 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:04.520925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 655/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jul 28 06:02:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:04.526758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:04.623809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448af4f6-107c-4ac7-a975-a8790f7d5ce8 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:04.656135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:04.656768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:04.657050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:04.657326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] PATH_INFO: `/v3/services` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:04.657991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:04.658294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:04.659656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c30c6-e9fc-4856-a159-aab76bc5ccb8 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:04.663920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 637/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jul 28 06:02:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:06.677729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d54d9-487e-410d-853d-bbe9e8603769 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:06.678286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d54d9-487e-410d-853d-bbe9e8603769 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:06.678286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d54d9-487e-410d-853d-bbe9e8603769 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:06.679544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 656/1293] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:02:06.685539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756bc72-c4b5-443a-a114-4b1396f8738c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:06.686235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756bc72-c4b5-443a-a114-4b1396f8738c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:06.686363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756bc72-c4b5-443a-a114-4b1396f8738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:06.706063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4756bc72-c4b5-443a-a114-4b1396f8738c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:02:06.707284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4756bc72-c4b5-443a-a114-4b1396f8738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:02:06.741930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:06.784724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 638/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:02:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:02:06.810024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d54d9-487e-410d-853d-bbe9e8603769 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:06.847960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:06.923556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d54d9-487e-410d-853d-bbe9e8603769 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:06.960234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:06.960782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:06.961056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:06.961319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:06.961999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:06.963363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484fda-46a3-4a85-a94b-1e19d05e6de9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:06.979460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 657/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jul 28 06:02:06 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:02:09.003070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a653-2eba-43de-bdf8-8daf9394b0c8 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.003605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a653-2eba-43de-bdf8-8daf9394b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.003605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0a653-2eba-43de-bdf8-8daf9394b0c8 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.005007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 639/1296] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:02:09.010246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.010666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.010776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.029016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:02:09.030193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:02:09.102315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 658/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:02:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 06:02:09.125718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a653-2eba-43de-bdf8-8daf9394b0c8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:09.224312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0a653-2eba-43de-bdf8-8daf9394b0c8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:09.259004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:09.259576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.259856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.260126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.260767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:09.262132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:09.270777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:09.272022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:09.273087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 640/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 06:02:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:09.278114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:09.295717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:09.374982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971dd94-d163-4baf-8e71-987735ceae12 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:09.407905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:09.408503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.408808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.409076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.409729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:09.410031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:09.411375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:09.416408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 659/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jul 28 06:02:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:09.422958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:09.453912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:09.520466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f7a3-d042-42b3-bd39-ca52f00867b2 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:09.552443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:09.553070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.553349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.553621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.554355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] RBAC: Adding query filter params (interface=public, service_id=42e9bc0256a6467aabea88455711b3b6, region_id=RegionOne) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:09.554661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:09.556031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca883b91-5d6b-4d36-bf33-fdccd47c9e03 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:09.560899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 641/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jul 28 06:02:09 2022] GET /identity/v3/endpoints?service_id=42e9bc0256a6467aabea88455711b3b6&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:09.567075 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:09.645121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:09.662689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a84f8-3f12-405a-9324-f7e77da3a3d2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:09.702297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:09.703224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:09.703435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:09.703707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:09.704533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:09.706301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c4b7-14d7-4fc4-8dae-a66013946535 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:09.713988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 660/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jul 28 06:02:09 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:02:11.693675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951327d-b76a-4640-ad10-50913eb279f5 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:11.694208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951327d-b76a-4640-ad10-50913eb279f5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:11.694208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951327d-b76a-4640-ad10-50913eb279f5 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:11.695580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 642/1302] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:02:11.700667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:11.701114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:11.701210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:11.720325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:02:11.721535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:02:11.788350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 661/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:02:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 06:02:11.810367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951327d-b76a-4640-ad10-50913eb279f5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:11.903017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:11.910422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951327d-b76a-4640-ad10-50913eb279f5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:11.942715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:11.943341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:11.943621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:11.943940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:11.944510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:11.945904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 06:02:11.955171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 06:02:11.956699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application with Lock( Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self._enter() Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application return self.creator() Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application created_value = creator( Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: ERROR keystone.server.flask.application Jul 28 06:02:11.958458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 643/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jul 28 06:02:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 06:02:11.963573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:12.042269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:12.064975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f72f73-8298-4c50-8ac0-e0b2e3d84b78 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:12.098707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:12.099324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:12.099604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:12.099874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:12.100538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:02:12.100870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:12.102226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d369c-7448-42ec-a92a-7237c1b70342 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:12.107288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 662/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jul 28 06:02:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:02:12.113062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:02:12.218503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186158e-9153-40fa-9683-2309612f9e33 None admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:02:12.254186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:02:12.257282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:02:12.257568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:02:12.257840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:02:12.258628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:02:12.260073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea7ad9-7e0f-40d8-a06c-daf5e62e1290 None admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:02:12.287319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 644/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:02:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:02:22.104484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=30 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:02:22.279469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:15.956465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c3fa-0442-4996-b653-771f94b58b54 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:15.957304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c3fa-0442-4996-b653-771f94b58b54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:15.957304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c3fa-0442-4996-b653-771f94b58b54 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:15.962680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 663/1307] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:15.964429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686a20-6300-4294-94ba-03f32e7fb11c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:15.965364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686a20-6300-4294-94ba-03f32e7fb11c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:15.966278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82686a20-6300-4294-94ba-03f32e7fb11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:16.050418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-82686a20-6300-4294-94ba-03f32e7fb11c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:16.052282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-82686a20-6300-4294-94ba-03f32e7fb11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:16.205212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 645/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:03:16.242014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:16.242238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:16.242511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:16.244123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 664/1309] 10.222.0.66 () {54 vars in 965 bytes} [Thu Jul 28 06:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:16.250626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8d-0f37-4faa-8677-9c7ef29670b6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:16.250971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8d-0f37-4faa-8677-9c7ef29670b6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:16.251168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98412d8d-0f37-4faa-8677-9c7ef29670b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:16.338717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-98412d8d-0f37-4faa-8677-9c7ef29670b6 None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:16.339930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-98412d8d-0f37-4faa-8677-9c7ef29670b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:16.362317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:16.438563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:16.440590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:16.444667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 646/1310] 10.222.0.66 () {58 vars in 1062 bytes} [Thu Jul 28 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:03:16.596581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf613-864c-486a-adc3-dee2f8ed95a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:16.673534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:16.674148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:16.674418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:16.674681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:16.676265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:16.733818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:16.792446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:16.793899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318ab0f-8b03-4d22-ba5e-2fe02f22c94f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:16.813229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 665/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:19.138539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:19.139057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:19.139138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:19.140700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 647/1312] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:19.146014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c157-b089-4c7b-a54d-ba7a50ba24ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:19.146669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c157-b089-4c7b-a54d-ba7a50ba24ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:19.146669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c157-b089-4c7b-a54d-ba7a50ba24ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:19.232404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4024c157-b089-4c7b-a54d-ba7a50ba24ec None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:19.234149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4024c157-b089-4c7b-a54d-ba7a50ba24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:19.337189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 666/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:19.376514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:19.378320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:19.497581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdc5c3-1c09-4054-afae-520c85b153c7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:19.610664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:19.613967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:19.615127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:19.615495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:19.616129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:19.618660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:19.755146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:19.756589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019afa5c-648e-4e09-80b3-65bc398e9014 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:19.779108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 648/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:22.108492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:22.109028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:22.109129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:22.110405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 667/1315] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:22.115466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac07e6-ae50-49d8-b491-ad887c44d1a1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:22.115926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac07e6-ae50-49d8-b491-ad887c44d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:22.116027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac07e6-ae50-49d8-b491-ad887c44d1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:22.181073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3bac07e6-ae50-49d8-b491-ad887c44d1a1 None None] MFA Rules not processed for user `0b6c84a7425943188e140f26883d6fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:22.182258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3bac07e6-ae50-49d8-b491-ad887c44d1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:22.233180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:22.277748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 649/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:03:22.317015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:22.318552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:22.329085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:22.421063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20469-84e8-49ea-adb4-7685e5756704 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:22.491929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:22.492462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:22.492766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:22.493034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:22.494633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:22.557192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:22.603408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:22.604869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5054e12-e607-492b-907d-885db3b56239 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:22.623555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 668/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:25.199313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:25.199879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:25.199879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:25.201273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 650/1318] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:25.206280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28fb0-334a-49b3-8216-343ad436c43d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:25.206705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28fb0-334a-49b3-8216-343ad436c43d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:25.206827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28fb0-334a-49b3-8216-343ad436c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:25.271209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-67f28fb0-334a-49b3-8216-343ad436c43d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:25.272420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67f28fb0-334a-49b3-8216-343ad436c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:25.373391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 669/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:25.411536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:25.413152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:25.517183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e368e58-5425-4f7d-9e6d-f6ee49451e11 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:25.590133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:25.590744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:25.591021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:25.591289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:25.593471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:25.600859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:25.706243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:25.707962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519235d-f2df-4e5b-a4f8-4a52dcb59b39 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:25.726713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 651/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:28.434943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826719ff-0827-4203-bb5e-ed92c38171b7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:28.435825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826719ff-0827-4203-bb5e-ed92c38171b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:28.435825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826719ff-0827-4203-bb5e-ed92c38171b7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:28.436820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 670/1321] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:28.442126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b7e25-4e34-4012-97fd-33174a1816b1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:28.442593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b7e25-4e34-4012-97fd-33174a1816b1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:28.442688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b7e25-4e34-4012-97fd-33174a1816b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:28.508976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1f6b7e25-4e34-4012-97fd-33174a1816b1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:28.510185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1f6b7e25-4e34-4012-97fd-33174a1816b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:28.577512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:28.620964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 652/1322] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:28.673622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:28.673910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:28.674207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:28.675577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 671/1323] 10.222.0.66 () {54 vars in 965 bytes} [Thu Jul 28 06:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:28.682155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35aedd-656f-451c-9ba1-bd883bec5c7a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:28.682485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35aedd-656f-451c-9ba1-bd883bec5c7a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:28.682760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35aedd-656f-451c-9ba1-bd883bec5c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:28.775121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5c35aedd-656f-451c-9ba1-bd883bec5c7a None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:28.776360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5c35aedd-656f-451c-9ba1-bd883bec5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:28.861556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 653/1324] 10.222.0.66 () {58 vars in 1062 bytes} [Thu Jul 28 06:03:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:28.871337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:28.873412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:28.895327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:28.988450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f28809-7528-4758-9288-d5761e3f5a28 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:29.065395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:29.066013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:29.066287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:29.066553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:29.068163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:29.141862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:29.181460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:29.182897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5b1fa-2edf-4f5a-aaea-83ed11c4480e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:29.203176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 672/1325] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:31.498957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:31.499488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:31.499612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:31.501080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 654/1326] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:31.506535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435b9f-c78b-4b88-a2d5-6fdd5da9fc3a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:31.506983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435b9f-c78b-4b88-a2d5-6fdd5da9fc3a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:31.507075 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435b9f-c78b-4b88-a2d5-6fdd5da9fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:31.573630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5a435b9f-c78b-4b88-a2d5-6fdd5da9fc3a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:31.574851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5a435b9f-c78b-4b88-a2d5-6fdd5da9fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:31.681263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 673/1327] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:31.720103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:31.721743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:31.782167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:31.828837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a607-3eac-4f92-bf05-21afc7af19a4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:31.902872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:31.903411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:31.903708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:31.903979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:31.905628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:32.018246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:32.021309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:32.023200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f22c7-c56b-491a-96f4-2a4837367ae6 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:32.043237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 655/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:34.125046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:34.125497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:34.125585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:34.126944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 674/1329] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:34.132668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8cf3-6775-4e65-946e-8277da19e3ed None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:34.133120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8cf3-6775-4e65-946e-8277da19e3ed None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:34.133363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8cf3-6775-4e65-946e-8277da19e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:34.200363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cfee8cf3-6775-4e65-946e-8277da19e3ed None None] MFA Rules not processed for user `0b6c84a7425943188e140f26883d6fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:34.202142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cfee8cf3-6775-4e65-946e-8277da19e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:34.321463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 656/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:34.361060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:34.362670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:34.395492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:34.467143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9bb19-9390-45d0-b5da-f00aac23905a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:34.539678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:34.540252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:34.540526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:34.540830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:34.542438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:34.623108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:34.655575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:34.657044 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c09f9-c7bb-4a68-aa1b-5afa6a49abb0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:34.675119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 675/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:37.114882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:37.115423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:37.115423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:37.116870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 657/1332] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:37.123267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deefb0-1123-4348-a2e8-007f7cb2f128 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:37.123835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deefb0-1123-4348-a2e8-007f7cb2f128 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:37.123835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deefb0-1123-4348-a2e8-007f7cb2f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:37.195361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-73deefb0-1123-4348-a2e8-007f7cb2f128 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:37.196584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-73deefb0-1123-4348-a2e8-007f7cb2f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:37.289941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 676/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:37.326655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:37.328167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:37.396251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:37.432689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d1e9-4174-41a0-b574-9fcc17826eff None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:37.505741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:37.506351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:37.506627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:37.506894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:37.508489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:37.615390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:37.616849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9637c74-3dce-4980-abfa-68c087d142ff service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:37.627217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:37.635416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 658/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:39.696139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:39.696741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:39.696741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:39.698073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 677/1335] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:39.703338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303142-6fd5-4caa-968a-9f596292f009 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:39.703733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303142-6fd5-4caa-968a-9f596292f009 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:39.703891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303142-6fd5-4caa-968a-9f596292f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:39.770750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-28303142-6fd5-4caa-968a-9f596292f009 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:39.771962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-28303142-6fd5-4caa-968a-9f596292f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:39.867861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 659/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:39.908130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:39.909691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:39.950935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:40.018824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f31af-726f-459a-9e5e-20cad133d7ff None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:40.090594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:40.091221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:40.091490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:40.091780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:40.093415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:40.174466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:40.202504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:40.203871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12945d6-a155-40d0-9628-8237f5c809dd service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:40.222030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 678/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:42.692901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:42.693444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:42.693444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:42.694839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 660/1338] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:42.700233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672abfcb-3e12-4f79-8f58-6ecccfe0771d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:42.701198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672abfcb-3e12-4f79-8f58-6ecccfe0771d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:42.701306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672abfcb-3e12-4f79-8f58-6ecccfe0771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:42.765491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-672abfcb-3e12-4f79-8f58-6ecccfe0771d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:42.766677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-672abfcb-3e12-4f79-8f58-6ecccfe0771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:42.861813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 679/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:42.901533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:42.903183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:42.977890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:43.006602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a032-0bbf-4f3e-8b10-ba04003ec9b0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:43.082935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:43.083559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:43.083836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:43.084102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:43.085772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:43.198068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:43.199502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43531a3-5d87-4ff5-9d93-754c22678da9 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:43.217700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 661/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:47.158492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:47.159025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:47.159025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:47.160799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 680/1341] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:47.166400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb39c-87fe-4baf-b021-9bb63c540dfa None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:47.166867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb39c-87fe-4baf-b021-9bb63c540dfa None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:47.166982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb39c-87fe-4baf-b021-9bb63c540dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:47.173635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:47.241996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-569cb39c-87fe-4baf-b021-9bb63c540dfa None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:47.243212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-569cb39c-87fe-4baf-b021-9bb63c540dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:47.356987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 662/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:47.398134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:47.399735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:47.458794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:47.530365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdddafd-8b3a-48d9-9d4b-907c9d7618dd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:47.615186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:47.615803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:47.616082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:47.616349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:47.618002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:47.711305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:47.730256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:47.731721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8a21-d1aa-4588-8964-5422385f496f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:47.750489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 681/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:50.387050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:50.387632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:50.387632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:50.389342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 663/1344] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:50.397034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427849bd-a745-4e57-80a7-dde160b0aac9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:50.397586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427849bd-a745-4e57-80a7-dde160b0aac9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:50.397586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427849bd-a745-4e57-80a7-dde160b0aac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:50.476305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-427849bd-a745-4e57-80a7-dde160b0aac9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:50.477752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-427849bd-a745-4e57-80a7-dde160b0aac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:50.593615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 682/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:50.631433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:50.632987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:50.730505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:50.749618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3490b-19e7-41da-b187-f8e24019aefe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:50.825892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:50.826513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:50.826787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:50.827055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:50.828807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:50.939861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:50.941242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9830c1-8d51-498a-95b0-07c9b5259d40 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:50.959372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 664/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:03:55.380943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:55.381527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:55.381527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:55.382882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 683/1347] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:03:55.388444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa692f3-9ff8-459c-846c-78ee60146b03 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:55.388966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa692f3-9ff8-459c-846c-78ee60146b03 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:55.389053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa692f3-9ff8-459c-846c-78ee60146b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:55.407123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:55.469552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-daa692f3-9ff8-459c-846c-78ee60146b03 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:03:55.470723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-daa692f3-9ff8-459c-846c-78ee60146b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:55.576529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 665/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:03:55.617065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:03:55.618635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:55.685374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:55.737970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752d570-3b9f-4d83-adf7-f6810848b48e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:03:55.819469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:03:55.820084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:03:55.820357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:03:55.820625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:03:55.822277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:03:55.945559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:03:55.949543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:03:55.951618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eafe34-4f46-4171-a0d9-3cedfd86443c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:03:55.978085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 684/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:00.939925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295fe6-7eca-4280-b546-bc6c0a0fe3f9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:00.940367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295fe6-7eca-4280-b546-bc6c0a0fe3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:00.940561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e295fe6-7eca-4280-b546-bc6c0a0fe3f9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:00.942138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 666/1350] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:00.948765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a20bc-c7a3-4c3d-ad0b-dd6c55710990 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:00.949206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a20bc-c7a3-4c3d-ad0b-dd6c55710990 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:00.950066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a20bc-c7a3-4c3d-ad0b-dd6c55710990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:01.112671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-845a20bc-c7a3-4c3d-ad0b-dd6c55710990 None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:01.114118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-845a20bc-c7a3-4c3d-ad0b-dd6c55710990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:01.236381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 685/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:04:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:05.354153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18cad-fbde-42a9-b1fb-41ad567edcbf None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:05.354994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18cad-fbde-42a9-b1fb-41ad567edcbf None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:05.355275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba18cad-fbde-42a9-b1fb-41ad567edcbf None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:05.357412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 667/1352] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:05.362190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041991e-a46b-43cb-97a2-efd4485f004c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:05.362605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041991e-a46b-43cb-97a2-efd4485f004c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:05.362753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041991e-a46b-43cb-97a2-efd4485f004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:05.420007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:05.446191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4041991e-a46b-43cb-97a2-efd4485f004c None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:05.447397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4041991e-a46b-43cb-97a2-efd4485f004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:05.562711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 686/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:04:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:05.574000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=59 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:07.029812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b470096-669e-4303-8ad9-6a6b3c63893c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:07.030448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b470096-669e-4303-8ad9-6a6b3c63893c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:07.030448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b470096-669e-4303-8ad9-6a6b3c63893c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:07.031752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 668/1354] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:07.036617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00650-6e73-4e5b-adcd-df7585abb1c6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:07.037029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00650-6e73-4e5b-adcd-df7585abb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:07.037311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00650-6e73-4e5b-adcd-df7585abb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:07.115315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07c00650-6e73-4e5b-adcd-df7585abb1c6 None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:07.116529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07c00650-6e73-4e5b-adcd-df7585abb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:07.158825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:07.227328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 687/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:04:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:10.543381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f452-18d3-4878-8a83-e40667eb14a1 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:10.544324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f452-18d3-4878-8a83-e40667eb14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:10.544899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51f452-18d3-4878-8a83-e40667eb14a1 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:10.546774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 669/1356] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:10.552291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf274a-8c75-4051-b739-df81a7383bc7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:10.552781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf274a-8c75-4051-b739-df81a7383bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:10.553030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf274a-8c75-4051-b739-df81a7383bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:10.627599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b5cf274a-8c75-4051-b739-df81a7383bc7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:10.628856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b5cf274a-8c75-4051-b739-df81a7383bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:10.731666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 688/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:10.787096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:10.787743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:10.788464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:10.791399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 670/1358] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jul 28 06:04:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:10.798493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193a3e-78c5-4fee-9c6c-1a839a48cf9a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:10.799405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193a3e-78c5-4fee-9c6c-1a839a48cf9a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:10.799990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb193a3e-78c5-4fee-9c6c-1a839a48cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:10.820622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:10.890704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fb193a3e-78c5-4fee-9c6c-1a839a48cf9a None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:10.894275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb193a3e-78c5-4fee-9c6c-1a839a48cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:11.019657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 689/1359] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jul 28 06:04:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:11.028270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:11.030025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:11.197210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f96b9-d7cf-4da8-bd25-4649eba2b9f9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:11.275581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:11.320235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:11.321143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:11.321498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:11.321845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:11.323539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:11.419500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:11.421116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9c0e8-ecad-4eb1-baa4-f7fb14a3e351 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:11.439784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 671/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:13.690280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:13.690807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:13.690915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:13.692323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 690/1361] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:13.698592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579688e6-ed7c-4737-b31c-8f4b4bb0ddd5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:13.699612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579688e6-ed7c-4737-b31c-8f4b4bb0ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:13.699924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579688e6-ed7c-4737-b31c-8f4b4bb0ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:13.769354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-579688e6-ed7c-4737-b31c-8f4b4bb0ddd5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:13.770749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-579688e6-ed7c-4737-b31c-8f4b4bb0ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:13.810471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:13.880674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 672/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:13.925643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:13.927236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:14.019492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:14.115262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739d246-26e9-443e-b23b-65a9a8ace621 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:14.277994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:14.278619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:14.278900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:14.279171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:14.280818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:14.303896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:14.384733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:14.387311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45a80a-6a35-47a2-80b1-4138d56f15d3 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:14.411654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 691/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:16.868274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc73b3d-382a-488b-bcef-8a369aac4b73 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:16.869128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc73b3d-382a-488b-bcef-8a369aac4b73 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:16.869212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc73b3d-382a-488b-bcef-8a369aac4b73 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:16.871425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 673/1364] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:16.877665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d185-ee21-4a17-913d-286e031ef5e0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:16.878167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d185-ee21-4a17-913d-286e031ef5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:16.878481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d185-ee21-4a17-913d-286e031ef5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:16.972496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4451d185-ee21-4a17-913d-286e031ef5e0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:16.974036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4451d185-ee21-4a17-913d-286e031ef5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:17.099374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:17.112676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 692/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:17.149361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:17.149703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:17.150096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:17.151604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 674/1366] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jul 28 06:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:17.157219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048a76-9657-4768-878e-f0352bab6783 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:17.157508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048a76-9657-4768-878e-f0352bab6783 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:17.157904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71048a76-9657-4768-878e-f0352bab6783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:17.243561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-71048a76-9657-4768-878e-f0352bab6783 None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:17.244789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-71048a76-9657-4768-878e-f0352bab6783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:17.375996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 693/1367] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jul 28 06:04:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:17.384017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:17.385616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:17.543142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426728-33fa-4bba-b70f-62a2fd61cc8c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:17.564793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:17.662419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:17.662941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:17.663214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:17.663479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:17.665107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:17.763127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:17.764741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11941a-5eb9-475a-a535-dd4f8177bd82 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:17.784334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 675/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:18.767652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873ed9-3238-4dd9-a1c3-9da1ebcc52ff None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:18.770157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873ed9-3238-4dd9-a1c3-9da1ebcc52ff None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:18.770157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873ed9-3238-4dd9-a1c3-9da1ebcc52ff None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:18.770157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 694/1369] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:18.775277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8fa-907f-4036-be89-0250e0d446b1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:18.775760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8fa-907f-4036-be89-0250e0d446b1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:18.775865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8fa-907f-4036-be89-0250e0d446b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:18.810060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:18.848303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-50f3b8fa-907f-4036-be89-0250e0d446b1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:18.849551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-50f3b8fa-907f-4036-be89-0250e0d446b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:18.958088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 676/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:19.307178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:19.307464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:19.307735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:19.309309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 695/1371] 10.222.0.66 () {54 vars in 964 bytes} [Thu Jul 28 06:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:19.314122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88befc54-b03f-4b33-8d0e-e93b6c908564 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:19.314407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88befc54-b03f-4b33-8d0e-e93b6c908564 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:19.314679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88befc54-b03f-4b33-8d0e-e93b6c908564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:19.399536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-88befc54-b03f-4b33-8d0e-e93b6c908564 None None] MFA Rules not processed for user `80869e16da504629b8763a9eb3c4c901`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:19.400691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-88befc54-b03f-4b33-8d0e-e93b6c908564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:19.455427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:19.489529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 677/1372] 10.222.0.66 () {58 vars in 1061 bytes} [Thu Jul 28 06:04:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:19.497253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:19.498998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:19.559875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:19.619618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f684-9385-4e83-8f6a-0f8bc66850a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:19.697543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:19.698307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:19.698692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:19.699749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:19.701513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:19.832910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:19.849035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:19.850834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645efb43-a696-4522-a0c2-dfc96ff918ed service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:19.877542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 696/1373] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:19.936266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:19.936746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:19.937002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:19.938194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 678/1374] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:19.944772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bbbbc-8b35-4047-8f99-2ad3395d8beb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:19.945641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bbbbc-8b35-4047-8f99-2ad3395d8beb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:19.946052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bbbbc-8b35-4047-8f99-2ad3395d8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:20.046771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f41bbbbc-8b35-4047-8f99-2ad3395d8beb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:20.049006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f41bbbbc-8b35-4047-8f99-2ad3395d8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:20.192956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 697/1375] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:20.236843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:20.238421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:20.386038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebff28c-3142-4768-9a25-f7492468dd77 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:20.442777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:20.510486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:20.511240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:20.511585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:20.511917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:20.513571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:20.611050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:20.612631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1e8b7-0ff5-44a4-a2a2-793b64ded655 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:20.630947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 679/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:22.664789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:22.665406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:22.665406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:22.666705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 698/1377] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:22.671856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40ac60-c18f-481d-8a11-6457b8433d45 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:22.672284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40ac60-c18f-481d-8a11-6457b8433d45 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:22.672554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40ac60-c18f-481d-8a11-6457b8433d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:22.747741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2f40ac60-c18f-481d-8a11-6457b8433d45 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:22.748979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2f40ac60-c18f-481d-8a11-6457b8433d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:22.755985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:22.857416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 680/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:22.906651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:22.908168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:22.977114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:23.068981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f175d-8b1c-4c20-9eaa-0087f9e34226 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:23.194688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:23.195298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:23.195567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:23.195828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:23.197451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:23.217163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:23.305825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:23.307417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bfc55-e0ef-420b-89fa-fd9fe640e9af service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:23.340538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 699/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:25.428372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:25.428978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:25.428978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:25.430507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 681/1380] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:25.437010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a89b7-8708-4fe9-b31f-0b6e6922f260 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:25.437610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a89b7-8708-4fe9-b31f-0b6e6922f260 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:25.437610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a89b7-8708-4fe9-b31f-0b6e6922f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:25.515156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bb5a89b7-8708-4fe9-b31f-0b6e6922f260 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:25.516362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bb5a89b7-8708-4fe9-b31f-0b6e6922f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:25.616652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:25.624192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 700/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:25.668746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:25.670426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:25.838291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:25.850337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ea0b-78c0-4d5c-964a-255416761d48 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:25.999589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:26.000814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:26.001348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:26.001751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:26.003649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:26.121366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:26.123113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f1b8e-bb32-4a03-9aa6-0bf988433f6a service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:26.136617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:26.147273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 682/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:28.214833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:28.215362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:28.215447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:28.216878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 701/1383] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:28.222294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e18be-25b6-491f-8b7f-321196e80d7a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:28.222701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e18be-25b6-491f-8b7f-321196e80d7a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:28.222813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e18be-25b6-491f-8b7f-321196e80d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:28.293461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-118e18be-25b6-491f-8b7f-321196e80d7a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:28.294708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-118e18be-25b6-491f-8b7f-321196e80d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:28.398822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 683/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:28.441038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:28.443511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:28.599974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55383037-aac6-49a5-a56d-521e00f4d9fc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:28.667316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:28.726752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:28.727417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:28.727649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:28.728119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:28.731144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:28.823202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:28.825343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94008963-594b-44b4-a098-e7519b5f069a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:28.845293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 702/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:30.942368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:30.942894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:30.942894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:30.944299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 684/1386] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:30.951492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6226ce-5e47-40b4-b9df-4af54c7b3516 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:30.951931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6226ce-5e47-40b4-b9df-4af54c7b3516 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:30.952041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6226ce-5e47-40b4-b9df-4af54c7b3516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:31.022990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8e6226ce-5e47-40b4-b9df-4af54c7b3516 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:31.024274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8e6226ce-5e47-40b4-b9df-4af54c7b3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:31.058779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:31.142193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 703/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:31.207985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:31.209628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:31.322500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:31.423729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa7c9-f61b-4e69-b19e-51600e62d9f6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:31.586424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:31.587077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:31.587363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:31.587651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:31.589513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:31.633366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:31.697337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:31.700028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec11e5-d5f7-4635-a273-437b12d0f371 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:31.723290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 685/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:33.800376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:33.800946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:33.800946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:33.802318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 704/1389] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:33.807466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93709a2-99d3-4ea3-91dd-4870be16109e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:33.807915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93709a2-99d3-4ea3-91dd-4870be16109e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:33.808067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93709a2-99d3-4ea3-91dd-4870be16109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:33.873817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a93709a2-99d3-4ea3-91dd-4870be16109e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:33.875025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a93709a2-99d3-4ea3-91dd-4870be16109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:33.971992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 686/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:34.021458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:34.023000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:34.188785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2cbac-7e10-4508-9cdf-72092701d36d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:34.207804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:34.318788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:34.319408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:34.319685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:34.319955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:34.321608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:34.413633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:34.415168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58606904-a0f7-4475-bdcb-8d560d9d7af6 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:34.434332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 705/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:35.039535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95701c0-aa77-43d3-bc28-cf9870217ff7 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:35.040128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95701c0-aa77-43d3-bc28-cf9870217ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:35.040128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95701c0-aa77-43d3-bc28-cf9870217ff7 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:35.041461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 687/1392] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:35.047183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc47f-fedd-41d5-b2d0-75a95707a40e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:35.047615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc47f-fedd-41d5-b2d0-75a95707a40e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:35.047799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc47f-fedd-41d5-b2d0-75a95707a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:35.073911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:35.116808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-16ccc47f-fedd-41d5-b2d0-75a95707a40e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:35.118016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-16ccc47f-fedd-41d5-b2d0-75a95707a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:35.212402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 706/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:35.267280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:35.267564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:35.267840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:35.269725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 688/1394] 10.222.0.66 () {54 vars in 966 bytes} [Thu Jul 28 06:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:35.274618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5820789-2c10-4479-9ca7-f349bc37c619 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:35.274908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5820789-2c10-4479-9ca7-f349bc37c619 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:35.275188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5820789-2c10-4479-9ca7-f349bc37c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:35.352341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d5820789-2c10-4479-9ca7-f349bc37c619 None None] MFA Rules not processed for user `86b70241972c476bb596c1634149e69b`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:35.353497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5820789-2c10-4479-9ca7-f349bc37c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:35.394306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:35.433451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 707/1395] 10.222.0.66 () {58 vars in 1063 bytes} [Thu Jul 28 06:04:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:35.441247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:35.442910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:35.457721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:35.551668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958c86-5925-4e4d-8e64-5b41c9e7eeca None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:35.629514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:35.630053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:35.630332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:35.630606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:35.632234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:35.700881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:35.742348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:35.743844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4008fcd-9ff5-449f-88dd-0eb186c5f3f4 service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:35.765598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 689/1396] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:36.495791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eae9-dcee-4f43-974e-4dcef00c953d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:36.496309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eae9-dcee-4f43-974e-4dcef00c953d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:36.496309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8eae9-dcee-4f43-974e-4dcef00c953d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:36.497771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 708/1397] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:36.503493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:36.503933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:36.504043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:36.533606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc5a-09e1-4b10-abaa-f268e0388c6b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:36.533898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc5a-09e1-4b10-abaa-f268e0388c6b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:36.534175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cc5a-09e1-4b10-abaa-f268e0388c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:36.587928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:36.589195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:36.607734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b913cc5a-09e1-4b10-abaa-f268e0388c6b None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:36.609067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b913cc5a-09e1-4b10-abaa-f268e0388c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:36.702361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 690/1398] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:36.704397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 709/1399] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:36.750356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:36.751637 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:36.755565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a69d6-33fd-4d4b-9118-74d662a70d0f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:36.755982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a69d6-33fd-4d4b-9118-74d662a70d0f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:36.756353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a69d6-33fd-4d4b-9118-74d662a70d0f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:36.757957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 710/1400] 10.222.0.66 () {54 vars in 943 bytes} [Thu Jul 28 06:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:36.770524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:36.770771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:36.771444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:36.798842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:36.851880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:36.860277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] MFA Rules not processed for user `cc4333399bc542e39a9f4d794dcccdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:36.861611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:36.905250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff04e4-f82a-4747-a6af-d04d3314c4c5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:36.975415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 711/1401] 10.222.0.66 () {58 vars in 1040 bytes} [Thu Jul 28 06:04:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:36.985323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:36.995297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889011-f026-4f24-96f0-75589482b6b5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:37.035389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:37.038937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:37.039241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:37.039527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:37.041573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:37.067497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:37.119635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:37.121076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:37.121076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:37.121076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:37.122428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:37.125483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:37.167325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:37.169345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f18662-75ae-4dea-8b90-51bc480ad008 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:37.191887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 691/1402] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:37.220322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:37.222010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9051575-5da0-46bf-8805-5940d9f67ff7 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:37.233489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 712/1403] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:04:39.288522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:39.289185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:39.289185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:39.290474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 692/1404] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:39.297386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f07ef-50cc-4c3b-a588-40e951a53e21 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:39.297929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f07ef-50cc-4c3b-a588-40e951a53e21 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:39.297929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f07ef-50cc-4c3b-a588-40e951a53e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:39.369958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-063f07ef-50cc-4c3b-a588-40e951a53e21 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:39.371119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-063f07ef-50cc-4c3b-a588-40e951a53e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:39.471024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:39.481966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 713/1405] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:39.526188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:39.527877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:39.690968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:39.694281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873dfc0-d6f1-4f90-9186-db9b0c9f0c36 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:39.835531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:39.836151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:39.836426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:39.836733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:39.838393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:39.961565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:39.965137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f74d35-b1b8-4262-a2ae-c047ec8be4cb service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:39.991170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 693/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:04:42.126273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:42.126829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:42.126829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:42.128177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 714/1407] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:42.133233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de20b-d8c7-4769-8cba-92c987c33c51 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:42.133661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de20b-d8c7-4769-8cba-92c987c33c51 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:42.133862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2de20b-d8c7-4769-8cba-92c987c33c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:42.138720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:42.207855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2c2de20b-d8c7-4769-8cba-92c987c33c51 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:42.209891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2c2de20b-d8c7-4769-8cba-92c987c33c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:42.320291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 694/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:04:42.368155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:04:42.369716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:42.560271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7262a-1fa1-4979-9aa7-04dd6891be1b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:04:42.669317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:42.741354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:04:42.742144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:42.742480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:42.742807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:42.744517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:42.852774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:04:42.854376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c7e51-2f49-4cca-ad73-b0832c0eba06 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:04:42.876253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 715/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:04:52.318193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=64 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:52.873680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=64 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:59.562365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968fd9-35d0-492b-9831-2f43298bfd32 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:59.562933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968fd9-35d0-492b-9831-2f43298bfd32 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:59.562933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968fd9-35d0-492b-9831-2f43298bfd32 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:59.564256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 695/1410] 10.222.0.66 () {54 vars in 918 bytes} [Thu Jul 28 06:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:59.569594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff364933-464d-43f2-a4c7-25c264c124f4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:59.570027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff364933-464d-43f2-a4c7-25c264c124f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:59.570166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff364933-464d-43f2-a4c7-25c264c124f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:59.650112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ff364933-464d-43f2-a4c7-25c264c124f4 None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:59.651341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff364933-464d-43f2-a4c7-25c264c124f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:59.758735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 716/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jul 28 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:04:59.773006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad044a7-8c0a-42c4-8ecb-b9803795f90b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:59.773299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad044a7-8c0a-42c4-8ecb-b9803795f90b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:59.773573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad044a7-8c0a-42c4-8ecb-b9803795f90b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:59.774923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 696/1412] 10.222.0.66 () {54 vars in 918 bytes} [Thu Jul 28 06:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:04:59.779974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707fd8a-e9b0-457f-933e-98f5cb7888e4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:04:59.780262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707fd8a-e9b0-457f-933e-98f5cb7888e4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:04:59.780538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707fd8a-e9b0-457f-933e-98f5cb7888e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:04:59.851771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:04:59.854475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8707fd8a-e9b0-457f-933e-98f5cb7888e4 None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:04:59.856851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8707fd8a-e9b0-457f-933e-98f5cb7888e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:04:59.975758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 717/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jul 28 06:04:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:02.446762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:02.447340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:02.447340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:02.448709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:02.453822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535ce7-8463-482c-bd7f-e5bdd9a15ace None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:02.454250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535ce7-8463-482c-bd7f-e5bdd9a15ace None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:02.454357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535ce7-8463-482c-bd7f-e5bdd9a15ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:02.519297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ff535ce7-8463-482c-bd7f-e5bdd9a15ace None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:02.520498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff535ce7-8463-482c-bd7f-e5bdd9a15ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:02.574583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:02.618183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:02.661144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:02.662666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:02.806974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454c1e-4e67-49ee-92fa-a935e6085a90 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:02.878441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:02.918055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:02.918675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:02.918952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:02.919225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:02.920868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:03.009964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:03.012154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fafd4-4412-4285-ba46-acd183622571 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:03.029782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 698/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:03.938698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:03.939270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:03.939270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:03.940600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:03.945444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db096e-e84c-4793-854b-a2539c6e5001 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:03.945827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db096e-e84c-4793-854b-a2539c6e5001 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:03.946007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db096e-e84c-4793-854b-a2539c6e5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:04.021462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b5db096e-e84c-4793-854b-a2539c6e5001 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:04.022674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b5db096e-e84c-4793-854b-a2539c6e5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:04.049632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:04.130910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:04.286397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:04.287915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:04.564099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cbfe7-ba72-46df-9e61-68307bca5f50 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:04.608333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:04.681567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:04.682215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:04.682527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:04.682912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:04.684529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:04.775921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:04.778123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58395f9-3b76-4d8e-8567-f0435858d146 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:04.796387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 720/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:05.685916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:05.686464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:05.686582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:05.687930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:05.692751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cfa-c8a0-4e72-9f92-f3a5059d439e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:05.693200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cfa-c8a0-4e72-9f92-f3a5059d439e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:05.693298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910cfa-c8a0-4e72-9f92-f3a5059d439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:05.754698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:05.777269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-63910cfa-c8a0-4e72-9f92-f3a5059d439e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:05.778459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-63910cfa-c8a0-4e72-9f92-f3a5059d439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:05.871386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:05:06.023077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:06.023361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:06.170174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f3bf7-db23-4723-a20a-25e41c7a6d9a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:06.182102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:06.284448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:06.285134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:06.285412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:06.285684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:06.287314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:06.379302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:06.380988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19cdcd-cbf1-48a6-a373-c8382752950a service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:06.398511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 701/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:07.259922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:07.260491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:07.260491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:07.262431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:07.267638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fea03-58b9-4762-9940-105d1c7bb971 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:07.268094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fea03-58b9-4762-9940-105d1c7bb971 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:07.268197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fea03-58b9-4762-9940-105d1c7bb971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:07.288464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:07.357421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b76fea03-58b9-4762-9940-105d1c7bb971 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:07.358562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b76fea03-58b9-4762-9940-105d1c7bb971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:07.461334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:07.613481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:07.615306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:07.731264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:07.767664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0f16f-4df9-4476-a119-cdc720f56a18 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:07.879183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:07.879713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:07.879988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:07.880254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:07.881882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:07.961128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:07.975256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:07.976858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17ebbe-7071-4cb2-96ee-0ebdb6f3a83e service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:07.995667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 723/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:08.859209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:08.859792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:08.859792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:08.861144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:08.868659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77ec4-c5fa-4d2f-b813-e75fe43ed290 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:08.869101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77ec4-c5fa-4d2f-b813-e75fe43ed290 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:08.869211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77ec4-c5fa-4d2f-b813-e75fe43ed290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:08.947698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-34c77ec4-c5fa-4d2f-b813-e75fe43ed290 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:08.949536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34c77ec4-c5fa-4d2f-b813-e75fe43ed290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:09.045574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:09.198222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:09.199659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:09.287755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:09.353018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03202a-3e22-44bc-bb9f-e3e61faa6498 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:09.473844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:09.474380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:09.474656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:09.474925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:09.476563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:09.527156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:09.569816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:09.571452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603462-b63a-4ce3-a3b8-6f16e0b2ee53 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:09.591435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 704/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:10.405243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:10.405842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:10.405842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:10.407205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:10.412086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4334a3-6f3e-4545-aeab-45b87d1bfc9f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:10.412530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4334a3-6f3e-4545-aeab-45b87d1bfc9f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:10.412660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4334a3-6f3e-4545-aeab-45b87d1bfc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:10.488497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0b4334a3-6f3e-4545-aeab-45b87d1bfc9f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:10.489744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0b4334a3-6f3e-4545-aeab-45b87d1bfc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:10.588898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:05:10.738421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:10.739811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:10.786894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:10.882323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682ac7-10bf-41fd-95bf-42c090e248a7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:10.991383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:10.991909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:10.992180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:10.992443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:10.994057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:11.000829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:11.083228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:11.084853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231767c-3567-4c94-8c36-586dac59257d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:11.103498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 726/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:11.905635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:11.906214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:11.906214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:11.907548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:11.912653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7937d6-4641-420c-8549-4b6dbc16bcbe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:11.913066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7937d6-4641-420c-8549-4b6dbc16bcbe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:11.913204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7937d6-4641-420c-8549-4b6dbc16bcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:11.992481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4d7937d6-4641-420c-8549-4b6dbc16bcbe None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:11.993708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d7937d6-4641-420c-8549-4b6dbc16bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:12.061536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:12.091874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:12.240604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:12.242095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:12.259226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:12.394500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219326e-4fce-4193-bc4d-3b6e3fd7fc20 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:12.481283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:12.509538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:12.510077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:12.510356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:12.510623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:12.512806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:12.602946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:12.604602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e38f-aaeb-4e7d-9b2d-737d5642e119 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:12.623239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 707/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:13.434705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:13.435278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:13.435278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:13.436579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:13.441383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864f6-6334-4930-9fd6-61dcf7a34009 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:13.441782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864f6-6334-4930-9fd6-61dcf7a34009 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:13.441931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864f6-6334-4930-9fd6-61dcf7a34009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:13.516310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-561864f6-6334-4930-9fd6-61dcf7a34009 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:13.517527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-561864f6-6334-4930-9fd6-61dcf7a34009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:13.560697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:13.621379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:13.771414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:13.772860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:13.919506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376771-48ac-4d0b-98c0-4ccc5930eb57 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:13.972386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:14.032794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:14.033415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:14.033693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:14.033961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:14.036782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:14.127408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:14.129021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15390a3-ab34-4719-a20e-4e48cc27ebca service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:14.147375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 729/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:14.997803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:14.998349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:14.998349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:14.999718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:15.004631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301cc5-99af-4d9f-b430-f399e1755766 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:15.005078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301cc5-99af-4d9f-b430-f399e1755766 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:15.005192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301cc5-99af-4d9f-b430-f399e1755766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:15.085368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0d301cc5-99af-4d9f-b430-f399e1755766 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:15.086760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d301cc5-99af-4d9f-b430-f399e1755766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:15.090299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:15.186743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:15.343787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:15.345459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:15.493676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd3678-a9c7-4b60-abe7-66bfc81879fb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:15.520501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:15.607130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:15.607639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:15.607913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:15.608185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:15.609830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:15.701980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:15.703570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3b53-aa38-4254-aece-d536308e6448 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:15.721992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 710/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:17.657334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:17.657902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:17.657902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:17.659246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:17.664389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0ffd-28bb-4c76-8625-412c2d923259 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:17.664866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0ffd-28bb-4c76-8625-412c2d923259 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:17.664972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b0ffd-28bb-4c76-8625-412c2d923259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:17.707869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:17.734297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c34b0ffd-28bb-4c76-8625-412c2d923259 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:17.735510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c34b0ffd-28bb-4c76-8625-412c2d923259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:17.834257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:17.873564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:17.875090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:17.978603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41bcdc-1b9a-4973-ae62-53b09244f6a8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:18.009940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:18.051844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:18.052461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:18.052773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:18.053083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:18.054654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:18.166691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:18.168161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a8468-1fb9-4cc5-a93f-11e606122495 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:18.186077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 732/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:05:20.351262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:20.352063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:20.352063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:20.353207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:05:20.359108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b30-a34a-4f43-b897-ca2696cf45dd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:20.359555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b30-a34a-4f43-b897-ca2696cf45dd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:20.359660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703b30-a34a-4f43-b897-ca2696cf45dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:20.432503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-50703b30-a34a-4f43-b897-ca2696cf45dd None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:20.434318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-50703b30-a34a-4f43-b897-ca2696cf45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:20.446968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:20.532550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:20.570562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:20.572068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:20.673469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881c8a-9067-4361-8b5b-a8cc25ecda7c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:20.685846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:20.750120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:20.750749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:20.751022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:20.751286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:20.753061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:20.868547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:20.870034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beaa444-ca53-4ecd-b9e6-796abe9e980d service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:20.888770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 713/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:05:23.229950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:23.230521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:23.230521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:23.231842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:23.237129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774981-fa90-4522-b382-97056bbde5c6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:23.237579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774981-fa90-4522-b382-97056bbde5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:23.237693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774981-fa90-4522-b382-97056bbde5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:23.289775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:23.308444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-70774981-fa90-4522-b382-97056bbde5c6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:23.309709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-70774981-fa90-4522-b382-97056bbde5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:23.416478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:23.455268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:23.456833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:23.557685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061c278-8fc4-437f-a502-eccda5bbebd7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:23.596848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:23.631179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:23.631791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:23.632067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:23.632334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:23.633968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:23.744402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:23.745840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f6aa-1958-451f-9142-9f6c2730f815 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:23.764043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 735/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:25.952494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:25.953135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:25.953135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:25.954421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:25.959864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c85e0-46dd-4de9-a3a8-f73686ce5197 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:25.960303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c85e0-46dd-4de9-a3a8-f73686ce5197 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:25.960422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c85e0-46dd-4de9-a3a8-f73686ce5197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:26.027645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-549c85e0-46dd-4de9-a3a8-f73686ce5197 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:26.029042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-549c85e0-46dd-4de9-a3a8-f73686ce5197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:26.053990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:26.132975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:26.171762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:26.173315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:26.291994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816cbd0-ad90-4bab-a00b-120afa835774 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:26.312800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:26.368254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:26.368907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:26.369180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:26.369445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:26.371618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:26.483640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:26.485119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c838f-7417-4976-a63a-9679e8ddce33 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:26.503417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 716/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:28.586770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:28.587310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:28.587310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:28.588670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:28.594647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18de75-d4b6-4aff-9f37-53348b46fb91 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:28.595091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18de75-d4b6-4aff-9f37-53348b46fb91 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:28.595261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18de75-d4b6-4aff-9f37-53348b46fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:28.659595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:28.662461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1e18de75-d4b6-4aff-9f37-53348b46fb91 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:28.664281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1e18de75-d4b6-4aff-9f37-53348b46fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:28.763348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:05:28.801568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:28.803049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:28.908463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ebaf7-9e41-4d55-b1b5-2e07f4b2390a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:28.960311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:28.985974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:28.986589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:28.986864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:28.987129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:28.988794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:29.100857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:29.102297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce5ba2-a456-451c-8a6c-635932545ddf service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:29.120234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 738/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:31.215160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:31.215725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:31.215725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:31.217178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:31.222689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e313f7-9c17-49da-a5b2-57d2fb0a7446 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:31.223145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e313f7-9c17-49da-a5b2-57d2fb0a7446 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:31.223257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e313f7-9c17-49da-a5b2-57d2fb0a7446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:31.290525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f5e313f7-9c17-49da-a5b2-57d2fb0a7446 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:31.291892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5e313f7-9c17-49da-a5b2-57d2fb0a7446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:31.321122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:31.388504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:31.427736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:31.429354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:31.535239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa339-9f23-4392-ac0a-dd8553a08700 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:31.563744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:31.611457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:31.612081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:31.612363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:31.612651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:31.614347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:31.728577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:31.729990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03318ce-6736-4ba9-b257-cacb771877b0 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:31.748371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 719/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:33.855470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:33.856051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:33.856051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:33.857436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:33.862811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257918d-44f6-4955-ac40-bd7a7d450928 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:33.863268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257918d-44f6-4955-ac40-bd7a7d450928 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:33.863440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257918d-44f6-4955-ac40-bd7a7d450928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:33.931404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a257918d-44f6-4955-ac40-bd7a7d450928 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:33.932607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a257918d-44f6-4955-ac40-bd7a7d450928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:33.941812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:34.031835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:34.069490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:34.071035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:34.178583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f74cc-cdfc-437e-9695-ea8ed516ac50 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:34.235409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:34.254041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:34.254659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:34.254938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:34.255232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:34.256877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:34.366164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:34.367594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9a0af-53c8-42d3-8e82-0343a39bb57b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:34.385409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 741/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:36.563540 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:36.565262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:36.565262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:36.565660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:36.571165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a83d-760d-47c6-9747-260634f0d8ee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:36.571851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a83d-760d-47c6-9747-260634f0d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:36.571851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a83d-760d-47c6-9747-260634f0d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:36.644431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1aa4a83d-760d-47c6-9747-260634f0d8ee None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:36.645984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1aa4a83d-760d-47c6-9747-260634f0d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:36.686017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:36.745152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:36.783862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:36.785555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:36.900378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec86e-3d4c-4215-b91a-794b6081f9e4 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:36.940237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:36.981696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:36.982321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:36.982593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:36.982862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:36.984495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:37.095939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:37.097650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49523-38b2-43f0-b9a0-a8b2d93b77eb service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:37.115799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 722/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:39.221490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:39.222067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:39.222067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:39.223384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:39.229013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397181f-f7c8-4d78-8ed7-cdb7fc53fef6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:39.230566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397181f-f7c8-4d78-8ed7-cdb7fc53fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:39.230857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397181f-f7c8-4d78-8ed7-cdb7fc53fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:39.303712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a397181f-f7c8-4d78-8ed7-cdb7fc53fef6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:39.304943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a397181f-f7c8-4d78-8ed7-cdb7fc53fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:39.322589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:39.405015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:39.441378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:39.442934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:39.548257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f0a6-2bcf-433d-9b30-d0c501174cac None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:39.618024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:39.625851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:39.626458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:39.626730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:39.626994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:39.628605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:39.736690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:39.738016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84346a2-4d88-4b2d-aa6f-71c84a82f61a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:39.756727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 744/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:41.783931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:41.784545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:41.784545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:41.785864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:05:41.791215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb3b2-c5bb-424b-ae7c-fa7301eba496 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:41.791656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb3b2-c5bb-424b-ae7c-fa7301eba496 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:41.791786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbb3b2-c5bb-424b-ae7c-fa7301eba496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:41.861310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ccbbb3b2-c5bb-424b-ae7c-fa7301eba496 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:05:41.862541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ccbbb3b2-c5bb-424b-ae7c-fa7301eba496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:41.910904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:41.958504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:05:41.996419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:05:41.997992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:42.111775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04bdf4-4ddc-460c-b859-7f8825c97074 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:05:42.164765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:42.191798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:05:42.192420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:05:42.192731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:05:42.193011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:05:42.194635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:05:42.306016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:05:42.307448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f926-0cb8-4c39-a12f-73e9276110d6 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:05:42.326772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 725/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:05:51.956781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=22 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:05:52.324446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=66 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:01.979649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2babf-132c-4767-92ac-920784d7f946 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:01.980736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2babf-132c-4767-92ac-920784d7f946 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:01.980736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2babf-132c-4767-92ac-920784d7f946 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:01.982059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 746/1471] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:01.987273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8217-3685-41aa-90ef-3a2482a7c4fc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:01.987716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8217-3685-41aa-90ef-3a2482a7c4fc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:01.987829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f8217-3685-41aa-90ef-3a2482a7c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:02.056533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fc2f8217-3685-41aa-90ef-3a2482a7c4fc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:02.057766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fc2f8217-3685-41aa-90ef-3a2482a7c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:02.154873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 726/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:06:02.240019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:02.240299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:02.240567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:02.241916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 747/1473] 10.222.0.66 () {54 vars in 966 bytes} [Thu Jul 28 06:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:02.246591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4af4b9-b013-4f93-b0b1-f681b6ba2be6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:02.246875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4af4b9-b013-4f93-b0b1-f681b6ba2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:02.247152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4af4b9-b013-4f93-b0b1-f681b6ba2be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:02.321994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3b4af4b9-b013-4f93-b0b1-f681b6ba2be6 None None] MFA Rules not processed for user `86b70241972c476bb596c1634149e69b`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:02.323205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3b4af4b9-b013-4f93-b0b1-f681b6ba2be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:02.345444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:02.400501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 727/1474] 10.222.0.66 () {58 vars in 1063 bytes} [Thu Jul 28 06:06:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:02.408539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:02.410042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:02.509669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e84b-8824-4157-9cb5-89fe03678d67 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:02.582240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:02.582880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:02.583150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:02.583415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:02.585350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:02.642988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:02.699777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:02.701261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a9f8f-914f-4496-a7c6-68e9d199a1ec service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:02.719805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 748/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:04.821299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:04.821881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:04.821881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:04.823771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 728/1476] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:04.828943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d595-6100-45a3-97cc-5745f6e9234a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:04.829337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d595-6100-45a3-97cc-5745f6e9234a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:04.829492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d595-6100-45a3-97cc-5745f6e9234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:04.897067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e3e9d595-6100-45a3-97cc-5745f6e9234a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:04.898583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e3e9d595-6100-45a3-97cc-5745f6e9234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:05.000787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 749/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:05.024441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:05.026012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:05.168206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9fc42-d5ef-4c16-b07b-816a09b0fda6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:05.219418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:05.265246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:05.265873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:05.266150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:05.266422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:05.267113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:05.268920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:06:05.268920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:06:05.268920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:06:05.270075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c3c77-b257-467c-adf1-e4d51849077b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:05.289676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 729/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jul 28 06:06:05 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:06:07.317732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:07.318293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:07.318293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:07.319652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 750/1479] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:07.325260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dc843-06a6-48a2-ab68-82b8e1adad10 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:07.325670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dc843-06a6-48a2-ab68-82b8e1adad10 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:07.325886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dc843-06a6-48a2-ab68-82b8e1adad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:07.520599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c26dc843-06a6-48a2-ab68-82b8e1adad10 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:07.522400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c26dc843-06a6-48a2-ab68-82b8e1adad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:07.622834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 730/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:07.667134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:07.668758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:07.678374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:07.819757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1d21-7b93-46b1-8c7c-15ee7774b2c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:07.898683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:07.931619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:07.932239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:07.932519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:07.933342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:07.934959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:08.022897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:08.024574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c64f96-e6f7-4308-beb1-da6300dbdbcd service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:08.044195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 751/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:10.238197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:10.238758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:10.238758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:10.240096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 731/1482] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:06:10.245329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db1c1-f8e8-4b31-be96-c54ba0082bf8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:10.245731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db1c1-f8e8-4b31-be96-c54ba0082bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:10.245877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db1c1-f8e8-4b31-be96-c54ba0082bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:10.312286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad6db1c1-f8e8-4b31-be96-c54ba0082bf8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:10.313445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad6db1c1-f8e8-4b31-be96-c54ba0082bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:10.360481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:10.410887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 752/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:10.447288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:10.448893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:10.472903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:10.559834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d58a-2e18-48b2-a646-7ceb11b54e7d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:10.633750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:10.634280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:10.634556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:10.634825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:10.636983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:10.709039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:10.746089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:10.747518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f545-319f-46cd-a986-ecb7e28f3e50 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:10.765563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 732/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:12.811399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:12.811966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:12.811966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:12.813323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 753/1485] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:12.819013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa71b-cbfd-43e6-97dc-32480fe46006 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:12.819473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa71b-cbfd-43e6-97dc-32480fe46006 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:12.819580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa71b-cbfd-43e6-97dc-32480fe46006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:12.883994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ff7fa71b-cbfd-43e6-97dc-32480fe46006 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:12.885144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ff7fa71b-cbfd-43e6-97dc-32480fe46006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:12.982799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 733/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:13.021934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:13.023438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:13.128775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e999-3868-4265-8aa4-ad7ee7a21217 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:13.201242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:13.203113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:13.204017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:13.204369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:13.204959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:13.206940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:13.316255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:13.317727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5af1a-225b-4172-8c4e-1fa2a772dec4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:13.337056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 754/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:15.433468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:15.434026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:15.434026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:15.435363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 734/1488] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:06:15.440544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391897-7903-4be0-aa2d-127120b96f3d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:15.441004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391897-7903-4be0-aa2d-127120b96f3d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:15.441238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83391897-7903-4be0-aa2d-127120b96f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:15.505728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-83391897-7903-4be0-aa2d-127120b96f3d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:15.506910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-83391897-7903-4be0-aa2d-127120b96f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:15.561417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:15.606734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 755/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:06:15.645925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:15.647466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:15.683990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:15.752249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8f5c4-3cc1-4204-964a-c97c61a484df None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:15.823144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:15.824298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:15.824553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:15.824846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:15.826437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:15.905566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:15.934312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:15.935743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee2bdc-49b5-4e58-a288-405734114e75 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:15.953621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 735/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:18.287366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:18.287921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:18.287921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:18.289321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 756/1491] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jul 28 06:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:06:18.294480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c1bbe-95b4-41f0-a2e1-91e1efad0fe5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:18.294920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c1bbe-95b4-41f0-a2e1-91e1efad0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:18.295017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c1bbe-95b4-41f0-a2e1-91e1efad0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:18.365378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b12c1bbe-95b4-41f0-a2e1-91e1efad0fe5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:06:18.366596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b12c1bbe-95b4-41f0-a2e1-91e1efad0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:18.464624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 736/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jul 28 06:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:06:18.503808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:06:18.505435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:18.610596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492a44-9f20-48ce-affb-2389d87eda0c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:06:18.684141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:06:18.684786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:06:18.685063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:06:18.685358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:06:18.686993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:06:18.696032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:18.803051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:06:18.804482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b8d3-1a3d-4637-8720-947494204165 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:06:18.824664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 757/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:06:28.463068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=82 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:06:28.821664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=50 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:53.132901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:53.133438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:53.133438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:53.207573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:07:53.208823 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:53.303806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 737/1494] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:07:53.312584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:53.313104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:53.313225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:53.387620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:07:53.388768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:53.483555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 758/1495] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:07:53.488207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:53.489634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:53.501213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5d7c9-2958-4250-ac7d-c5cb57b9ccf7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:53.561212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:53.595136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:53.595738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:53.596010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:53.596277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:53.596995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:07:53.597295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:53.598299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:53.598299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:07:53.598299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:07:53.599174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:53.610655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 738/1496] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:07:53.619323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:53.628586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee7ac6-0492-4d35-ad0d-8dd2a0634304 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:53.692797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:53.728380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:53.729024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:53.729306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:53.729575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:53.730232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:53.732042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:53.732042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:07:53.732042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:07:53.733254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:53.787606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 759/1497] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:07:53 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:07:53.791831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:53.793417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:53.826597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460b2f-e528-400c-a2f1-087800fdd372 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:53.920285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:53.920923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:53.921200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:53.921468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:53.922132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:53.923140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:53.923140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:07:53.923140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:07:53.924334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:53.966347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 739/1498] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:07:53 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:07:53.970416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:53.971968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.033054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be531a-7bbf-4c39-88e0-498e015444ba admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:54.116000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:54.127726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:54.128340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.128616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.128917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.129604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:54.130608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:54.130608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:07:54.130608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:07:54.131484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:54.144505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 760/1499] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:07:54.148517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:54.150082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.161545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc4eb-03ec-463b-a675-97a4b1eb6482 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:54.186638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:54.256167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:54.256732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.257009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.257276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.257954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:54.258960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:54.258960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:07:54.258960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:07:54.260472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad0b01-19cb-494a-b21a-d3de0e5806f7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:54.272563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 740/1500] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:07:54.276983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:54.278546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.311736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1b7e2-55fd-4acf-b617-5246d4469eab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:54.404717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:54.405428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.405647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.405915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] PATH_INFO: `/v3/projects/60fad603ab014941959967a6ded1947d/users/ba324f38af0a46ccb94f20667a2783aa/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.427303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fad603ab014941959967a6ded1947d, user_id=ba324f38af0a46ccb94f20667a2783aa, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:54.428328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:54.428328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:07:54.428328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:07:54.430302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7f959-e67b-4a7b-8f21-aa60e27b8273 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:54.455692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 761/1501] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:07:54 2022] PUT /identity/v3/projects/60fad603ab014941959967a6ded1947d/users/ba324f38af0a46ccb94f20667a2783aa/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:07:54.468168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d11bc-8c07-4a7b-be1d-4be60dd6910c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.468480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d11bc-8c07-4a7b-be1d-4be60dd6910c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.468787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d11bc-8c07-4a7b-be1d-4be60dd6910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.527199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ba1d11bc-8c07-4a7b-be1d-4be60dd6910c None None] MFA Rules not processed for user `ba324f38af0a46ccb94f20667a2783aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:07:54.528404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ba1d11bc-8c07-4a7b-be1d-4be60dd6910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.604508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 741/1502] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:07:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:07:54.617399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.617686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.617959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.619908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 762/1503] 10.222.0.66 () {54 vars in 964 bytes} [Thu Jul 28 06:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:07:54.624621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000836cd-efcb-4ead-a2df-820d120d903c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.624938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000836cd-efcb-4ead-a2df-820d120d903c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.625219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000836cd-efcb-4ead-a2df-820d120d903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.655443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:54.699911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-000836cd-efcb-4ead-a2df-820d120d903c None None] MFA Rules not processed for user `80869e16da504629b8763a9eb3c4c901`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:07:54.701149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-000836cd-efcb-4ead-a2df-820d120d903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.776253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 742/1504] 10.222.0.66 () {58 vars in 1061 bytes} [Thu Jul 28 06:07:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:07:54.784274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:54.785740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:54.836300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:54.890123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e094ecd-2391-44ff-b244-e5486cf16940 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:54.964927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:54.965542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:54.965823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:54.966097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:54.967705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:55.063822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:55.065202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:55.068657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:55.083117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 763/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:07:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:07:55.128652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5024-d8bc-4ed5-a280-4ff0c713e762 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:55.128961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5024-d8bc-4ed5-a280-4ff0c713e762 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:55.129241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5024-d8bc-4ed5-a280-4ff0c713e762 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:55.130525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 743/1506] 10.222.0.66 () {52 vars in 830 bytes} [Thu Jul 28 06:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:07:55.134082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:55.135321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:55.237190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb09f-a56c-46f7-8c04-ff7208a63151 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:55.328585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:55.329175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:55.329454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:55.329723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] PATH_INFO: `/v3/users/ba324f38af0a46ccb94f20667a2783aa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:55.342480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba324f38af0a46ccb94f20667a2783aa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:55.343503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:55.343503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:07:55.343503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:07:55.344735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:55.354336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:55.406262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba324f38af0a46ccb94f20667a2783aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:55.406881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba324f38af0a46ccb94f20667a2783aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:55.424333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba324f38af0a46ccb94f20667a2783aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:55.433159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba324f38af0a46ccb94f20667a2783aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:55.433571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba324f38af0a46ccb94f20667a2783aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:55.450726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 764/1507] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:07:55 2022] DELETE /identity/v3/users/ba324f38af0a46ccb94f20667a2783aa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:07:55.455228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:55.455703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:55.455800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:55.513195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:07:55.514499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:55.589937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:55.602461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 744/1508] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:07:55.612091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:55.613398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:55.721547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4708c-aefb-41a0-adc2-572bb514b5b6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:55.774797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:07:55.795674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:55.796319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:55.796594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:55.796923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:55.798528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:55.908278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:55.909642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e431-2672-4d4a-9269-41873c64f1c9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:55.927654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 765/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:07:56.265874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:07:56.267130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:07:56.279359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7a718-2bfa-4b21-87b3-506191dd7285 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:07:56.376080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:07:56.376747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:07:56.377022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:07:56.377292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] PATH_INFO: `/v3/projects/60fad603ab014941959967a6ded1947d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:07:56.387580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fad603ab014941959967a6ded1947d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:07:56.388775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:07:56.388775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:07:56.388775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:07:56.389951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:07:56.446053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fad603ab014941959967a6ded1947d', 'request_id': 'req-32196c21-0b8a-4d07-bb75-3342458076bf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:56.458892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fad603ab014941959967a6ded1947d', 'request_id': 'req-32196c21-0b8a-4d07-bb75-3342458076bf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:56.465977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fad603ab014941959967a6ded1947d', 'request_id': 'req-32196c21-0b8a-4d07-bb75-3342458076bf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:56.492664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] The token cache is being invalidate because project 60fad603ab014941959967a6ded1947d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:07:56.492969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:56.493478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-32196c21-0b8a-4d07-bb75-3342458076bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:07:56.494808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 745/1510] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:07:56 2022] DELETE /identity/v3/projects/60fad603ab014941959967a6ded1947d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:08:05.925401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=62 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:08:06.490797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:09:43.976387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:43.977134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:43.977134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:43.978351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:09:43.983685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac276f-8998-4e0c-9c1e-eaeab43e1f80 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:43.984143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac276f-8998-4e0c-9c1e-eaeab43e1f80 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:43.984251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac276f-8998-4e0c-9c1e-eaeab43e1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:44.066916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-61ac276f-8998-4e0c-9c1e-eaeab43e1f80 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:44.068113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61ac276f-8998-4e0c-9c1e-eaeab43e1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:44.174446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:44.329001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:09:44.331117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:44.451013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b44c-7c80-4e62-a4de-6d1193517107 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:09:44.456529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:09:44.457171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:44.457453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:44.457727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:44.466088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:09:44.467664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56bcc1-648b-4d26-8c7c-360e1b5c0a3c service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:09:44.477056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 767/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:09:45.309212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907441-81e6-4141-a018-6cbd41968465 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:45.309771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907441-81e6-4141-a018-6cbd41968465 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:45.309771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907441-81e6-4141-a018-6cbd41968465 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:45.311258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:09:45.316136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c42b5-0ec6-43a4-8d34-cfbb0331e565 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:45.316570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c42b5-0ec6-43a4-8d34-cfbb0331e565 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:45.316713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c42b5-0ec6-43a4-8d34-cfbb0331e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:45.335756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a89c42b5-0ec6-43a4-8d34-cfbb0331e565 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:45.337257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a89c42b5-0ec6-43a4-8d34-cfbb0331e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:45.345627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:45.503903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907441-81e6-4141-a018-6cbd41968465 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:09:45.518694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907441-81e6-4141-a018-6cbd41968465 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:09:45.524132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:09:45.524775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:45.525054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:45.525325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:45.534095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:09:45.535674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90c27-ddbd-4c11-829f-5b3076dca4b0 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:09:45.544954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 748/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:09:45.699626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bfe83-5332-4f0e-acf5-a507b727fa0f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:45.699975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bfe83-5332-4f0e-acf5-a507b727fa0f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:45.700265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bfe83-5332-4f0e-acf5-a507b727fa0f None None] PATH_INFO: `/v3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:45.701590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 769/1517] 10.222.0.40 () {54 vars in 925 bytes} [Thu Jul 28 06:09:45 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:09:45.707514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18c46-8a12-4a18-96f9-cca0974714bb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:45.707803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18c46-8a12-4a18-96f9-cca0974714bb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:45.708078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c18c46-8a12-4a18-96f9-cca0974714bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:45.770255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a7c18c46-8a12-4a18-96f9-cca0974714bb None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:45.771465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a7c18c46-8a12-4a18-96f9-cca0974714bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:45.787907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:09:45.841501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 749/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 28 06:09:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:54.877573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9956-e89c-42ec-9401-9469dfa424b0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:54.878094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9956-e89c-42ec-9401-9469dfa424b0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:54.878094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9956-e89c-42ec-9401-9469dfa424b0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:54.879384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 770/1519] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jul 28 06:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:09:54.884209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd7f2-cf72-4324-8497-b767a47eec0a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:54.884679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd7f2-cf72-4324-8497-b767a47eec0a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:54.884790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd7f2-cf72-4324-8497-b767a47eec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:54.904672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-993dd7f2-cf72-4324-8497-b767a47eec0a None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:54.905958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-993dd7f2-cf72-4324-8497-b767a47eec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:54.914702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 750/1520] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jul 28 06:09:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:54.922880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9956-e89c-42ec-9401-9469dfa424b0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:09:54.935962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9956-e89c-42ec-9401-9469dfa424b0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:09:54.941006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:09:54.941606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:54.941880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:54.942145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:54.950492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:09:54.952032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c961b-511c-4619-aea8-0be75e5e1458 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:09:54.961590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 771/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:09:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:09:56.776600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f424-8c98-42b0-acd5-bdf009f49f47 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:56.777194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f424-8c98-42b0-acd5-bdf009f49f47 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:56.777194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f424-8c98-42b0-acd5-bdf009f49f47 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:56.778552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:09:56.783349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f029c9-bb0a-4721-bbf4-8cc1ce538bea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:56.783780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f029c9-bb0a-4721-bbf4-8cc1ce538bea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:56.783877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f029c9-bb0a-4721-bbf4-8cc1ce538bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:56.803447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b6f029c9-bb0a-4721-bbf4-8cc1ce538bea None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:56.804677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6f029c9-bb0a-4721-bbf4-8cc1ce538bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:56.815428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:56.967953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162f424-8c98-42b0-acd5-bdf009f49f47 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:09:56.983034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162f424-8c98-42b0-acd5-bdf009f49f47 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:09:56.988419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:09:56.989078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:56.989365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:56.989634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:56.998358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:09:56.999929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249842d3-248d-4d16-977c-cfb1b1f34435 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:09:57.009363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 752/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:09:57.824363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d947-321a-4e55-8387-7c79bbfbb9fb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:57.824977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d947-321a-4e55-8387-7c79bbfbb9fb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:57.824977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d947-321a-4e55-8387-7c79bbfbb9fb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:57.826308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 06:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:09:57.831081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4263f7-025e-45c1-aead-56eec3cf7b94 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:57.831493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4263f7-025e-45c1-aead-56eec3cf7b94 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:57.831635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4263f7-025e-45c1-aead-56eec3cf7b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:57.850800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7d4263f7-025e-45c1-aead-56eec3cf7b94 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:09:57.852000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7d4263f7-025e-45c1-aead-56eec3cf7b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:09:57.859917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 06:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:09:58.008913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d947-321a-4e55-8387-7c79bbfbb9fb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:09:58.023626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d947-321a-4e55-8387-7c79bbfbb9fb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:09:58.029580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:09:58.030179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:09:58.030457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:09:58.030729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:09:58.038646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:09:58.040204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da8df7-c3b2-4863-8620-197d3e605c51 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:09:58.050107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 774/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:10:01.822615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:01.823162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:01.823279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:01.824545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:10:01.829687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3718e3-f40f-46cd-a144-28bf0557d983 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:01.830138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3718e3-f40f-46cd-a144-28bf0557d983 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:01.830244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3718e3-f40f-46cd-a144-28bf0557d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:01.850940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-df3718e3-f40f-46cd-a144-28bf0557d983 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:10:01.852118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-df3718e3-f40f-46cd-a144-28bf0557d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:01.860557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:10:01.931587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:10:01.933330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:02.009804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec8b2-2771-4056-bf56-bbe2ec8c414d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:10:02.013815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:10:02.014435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:02.014712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:02.014984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:02.023688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:10:02.025158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc212fd-7c39-480e-8e80-8fdf72a32cf0 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:10:02.034910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 755/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:10:04.037353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714090bc-8c50-4f16-9bb8-3d48a95371c1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:04.037937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714090bc-8c50-4f16-9bb8-3d48a95371c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:04.037937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714090bc-8c50-4f16-9bb8-3d48a95371c1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:04.039253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:10:04.044976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb085-364c-4eae-9937-234236d17012 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:04.045363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb085-364c-4eae-9937-234236d17012 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:04.045527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fb085-364c-4eae-9937-234236d17012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:04.064495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e04fb085-364c-4eae-9937-234236d17012 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:10:04.065718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e04fb085-364c-4eae-9937-234236d17012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:04.073447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:10:04.109860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714090bc-8c50-4f16-9bb8-3d48a95371c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:10:04.120504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714090bc-8c50-4f16-9bb8-3d48a95371c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:10:04.124154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:10:04.124614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:04.124931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:04.125202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:04.134046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:10:04.135975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e185fc9-51ca-4112-b006-758736187f1e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:10:04.146401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 777/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:10:07.628543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:07.629153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:07.629153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:07.630498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:10:07.635712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2784f-927c-461d-8030-57f54132df4c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:07.636136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2784f-927c-461d-8030-57f54132df4c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:07.636257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2784f-927c-461d-8030-57f54132df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:07.643809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:10:07.656771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a0e2784f-927c-461d-8030-57f54132df4c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:10:07.657974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a0e2784f-927c-461d-8030-57f54132df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:07.665692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:10:07.972036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:10:07.973732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:08.037630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:10:08.050892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8416-8edd-42a3-a4b4-4b8ff8ef188a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:10:08.054477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:10:08.055095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:08.055381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:08.055652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:08.064695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:10:08.066164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83116e4e-1877-4aa2-ae05-80ae54ca1fd6 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:10:08.076018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 758/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:10:10.104919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:10.105369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:10.105484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:10.106818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 06:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:10:10.111923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26e01-bd5f-4058-8788-816825a6f71c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:10.112311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26e01-bd5f-4058-8788-816825a6f71c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:10.112469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff26e01-bd5f-4058-8788-816825a6f71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:10.132023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-eff26e01-bd5f-4058-8788-816825a6f71c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:10:10.133247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eff26e01-bd5f-4058-8788-816825a6f71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:10.141006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 06:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:10:10.447336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:10:10.449076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:10:10.462067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149e07-72a4-470a-aabd-2166aff95af7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:10:10.465600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:10:10.466196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:10:10.466471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:10:10.466739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:10:10.475516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:10:10.477014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc0d-8188-4800-8a84-b7f8ba64b5d8 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:10:10.486780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 780/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:10:20.127366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=11 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:10:20.482809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=8 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:49.597822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.598995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.599512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.623184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:49.625516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:49.639576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 760/1540] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:49.649347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.649912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.649912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.678608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:49.679858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:49.698122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 781/1541] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:49.703662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:49.714560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ad090-c8e1-481d-981a-c3b54b59c409 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:49.725026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:49.726051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.726559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.727061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.727981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:49.728523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:49.730381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b60d2d-f50c-4bba-b1fd-aff60828fc9a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:49.744384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 761/1542] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:49.753387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:49.769451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4f05b-1986-4524-99b5-e8f84cd32e49 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:49.785379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:49.786023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.786341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.786699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.787754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:49.789943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:49.803803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3912ab-f8f5-4a3d-84b6-aecf5d1cf5e1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.804464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3912ab-f8f5-4a3d-84b6-aecf5d1cf5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.804982 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3912ab-f8f5-4a3d-84b6-aecf5d1cf5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.836273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7d3912ab-f8f5-4a3d-84b6-aecf5d1cf5e1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:49.838153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7d3912ab-f8f5-4a3d-84b6-aecf5d1cf5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:49.855455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 762/1543] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:11:49.865439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d14e-efb0-4412-9b72-9c4158325f90 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.866002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 782/1544] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:49.866528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d14e-efb0-4412-9b72-9c4158325f90 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:49.867019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d14e-efb0-4412-9b72-9c4158325f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:49.890231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:49.892726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6731d14e-efb0-4412-9b72-9c4158325f90 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:49.894336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6731d14e-efb0-4412-9b72-9c4158325f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:49.997414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 763/1545] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:11:49.999173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9935-1ed1-495e-8eee-25e7fd46c458 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:49.999684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9935-1ed1-495e-8eee-25e7fd46c458 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.000764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9935-1ed1-495e-8eee-25e7fd46c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.025368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-531b9935-1ed1-495e-8eee-25e7fd46c458 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.025611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b955-edf0-4dc5-84f9-c38654934b61 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.027323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-531b9935-1ed1-495e-8eee-25e7fd46c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.037566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 764/1546] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.038910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1095-f4cd-43e7-b051-f084f2841770 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.039199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1095-f4cd-43e7-b051-f084f2841770 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.039469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1095-f4cd-43e7-b051-f084f2841770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.041697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.045801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.046331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.047375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.048277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.049564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:11:50.049564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:11:50.049564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:11:50.051377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.079044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e9ad1095-f4cd-43e7-b051-f084f2841770 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.079916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 783/1547] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:49 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.080259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9ad1095-f4cd-43e7-b051-f084f2841770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.081417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.088904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 765/1548] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.090149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693bc0-a0e3-4f7a-84d4-949a5fb0667b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.090432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693bc0-a0e3-4f7a-84d4-949a5fb0667b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.090734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc693bc0-a0e3-4f7a-84d4-949a5fb0667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.095481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b56d2-7201-48e0-96c5-5d50fa1fef84 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.101110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.101760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.102175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.102450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.103182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.103489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.104488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:11:50.104488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:11:50.104488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:11:50.105408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b0863-cf4c-4ee6-adb4-626d6e1372c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.113350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dc693bc0-a0e3-4f7a-84d4-949a5fb0667b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.114697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dc693bc0-a0e3-4f7a-84d4-949a5fb0667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.120966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 784/1549] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.122256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996fb9-60a3-4dd7-bee4-7015ca2aa0b7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.122535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996fb9-60a3-4dd7-bee4-7015ca2aa0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.122800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996fb9-60a3-4dd7-bee4-7015ca2aa0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.130970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 766/1550] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.133306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.134813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.135432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.146117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c4996fb9-60a3-4dd7-bee4-7015ca2aa0b7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.147331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4996fb9-60a3-4dd7-bee4-7015ca2aa0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.155410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 785/1551] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.157675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3698cd-be22-441f-a257-f65ffcccf79f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.157989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3698cd-be22-441f-a257-f65ffcccf79f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.158257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3698cd-be22-441f-a257-f65ffcccf79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.159254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.160912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.169440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 767/1552] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.170450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.178689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8f3698cd-be22-441f-a257-f65ffcccf79f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.179879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f3698cd-be22-441f-a257-f65ffcccf79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.182472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9a83-faa9-430c-80c6-c7f59f79cb11 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.187229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.187789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 786/1553] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.187913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.188114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.188390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.189018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.189297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.189411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.189669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.190988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5bf5c-a20a-49a4-b09f-97120f964f50 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.205181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 768/1554] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:50.205181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f73-2d4d-48ea-b9f6-cd04d4dc0dae None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.205181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f73-2d4d-48ea-b9f6-cd04d4dc0dae None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.205181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f2f73-2d4d-48ea-b9f6-cd04d4dc0dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.211250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.212744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.224680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a94f2f73-2d4d-48ea-b9f6-cd04d4dc0dae None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.225905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a94f2f73-2d4d-48ea-b9f6-cd04d4dc0dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.228898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 787/1555] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.229811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.235095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 769/1556] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.236331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a55f-6492-4834-8f75-4b48b488e632 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.236619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a55f-6492-4834-8f75-4b48b488e632 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.236925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a55f-6492-4834-8f75-4b48b488e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.241734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2fd1a-17ed-458e-94cd-3ef32832826e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.247387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.247994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.248270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.248590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.249448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.251359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.257676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9b40a55f-6492-4834-8f75-4b48b488e632 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.259403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9b40a55f-6492-4834-8f75-4b48b488e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.269900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 770/1557] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.271583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c609fd-aa24-4ad7-8f81-582d737f6717 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.271818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c609fd-aa24-4ad7-8f81-582d737f6717 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.272087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c609fd-aa24-4ad7-8f81-582d737f6717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.282743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 788/1558] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.283713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.293475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-25c609fd-aa24-4ad7-8f81-582d737f6717 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.294698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-25c609fd-aa24-4ad7-8f81-582d737f6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.352168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:50.356384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f122c9e-067a-4a40-a28e-44926b3967d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.364799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.365288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.365581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.366202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.367176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.367589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.369892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 771/1559] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.370607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.371297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc73e-0361-430a-9b29-f6e573fc7961 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.371585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc73e-0361-430a-9b29-f6e573fc7961 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.371860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bc73e-0361-430a-9b29-f6e573fc7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.383921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 789/1560] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.385608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.396104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a84bc73e-0361-430a-9b29-f6e573fc7961 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.397409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803876a4-5dab-4ed5-87ed-15145f31023c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.397870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a84bc73e-0361-430a-9b29-f6e573fc7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.401783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.402246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.402504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.402880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.403452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.405181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.406137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 772/1561] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.407942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.408328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.408747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.427208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 790/1562] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:50.427208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.430263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce0de-ad87-4554-9d27-5a6178267427 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.434453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:50.434836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.435435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.435650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:50.435750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.435960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.436652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.436960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.439261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.444466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 773/1563] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:50.445441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.455103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26e55-5000-4786-a3b3-6a3e49f31eed None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.455364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 791/1564] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.456066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.464296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.465211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.465486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.465754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.467051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.467359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.469001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.469819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dec7d-4034-4dd5-a221-5deb2552d272 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.474635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.475241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.475524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.475800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.475992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:50.476458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.479166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.481927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 774/1565] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.482733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.493128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497bd73-e8ec-46de-81e9-791b11a8e804 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.498376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.498992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.499270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.499668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.500846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.501275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.502911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.507994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 792/1566] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.507994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.517003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5695af-aa07-456a-8a9d-aff362d977a3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.524293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 775/1567] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.524293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.527453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.528107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.528354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.528679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.529332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.531401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.534143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8dee-ef7d-418a-8dd8-55fd0d5c005a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.538940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.539543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.539817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.540085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.540791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.541095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.542665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.555749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 776/1568] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.557462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.564827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 793/1569] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.564827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.570386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5b72f-901f-49d9-8724-f89cf3b68d14 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.628794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780210c-0d18-4c50-bed9-a523e925e5ca admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.629093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.629776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.630084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.630360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] PATH_INFO: `/v3/projects/c4b0b4e5044a419a99876661ce6f9e96/users/0db6c2215b304cb3af3aebc565d55278/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.633332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.633944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.634224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.634498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.635182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:11:50.635482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.637104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.645283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b0b4e5044a419a99876661ce6f9e96, user_id=0db6c2215b304cb3af3aebc565d55278, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.646318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:11:50.646318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:11:50.646318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:11:50.648832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.649448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 794/1570] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:11:50.650250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.662448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13e74-eb6a-47d6-ba70-662ed113f779 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.667819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 777/1571] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:50 2022] PUT /identity/v3/projects/c4b0b4e5044a419a99876661ce6f9e96/users/0db6c2215b304cb3af3aebc565d55278/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:50.669160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.727419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.728051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.728332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.728627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.729485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.731387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.736756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e98d-d5e5-424f-8931-ebf0b1f0091a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.741622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.742256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.742530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.742802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.743466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.744485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:11:50.744485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:11:50.744485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:11:50.745844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.766405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 795/1572] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.767286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.777103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:50.780676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 778/1573] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.785650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.830180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:50.838775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df495-de5b-46c4-8c34-e01b81f720b5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.851708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5ded-9b8b-41ac-8656-f0a4b3aa859c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.857151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.857784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.858073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.858346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.859016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.861550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.891887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 779/1574] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:50.893514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.899102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.900414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.900890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.901162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.901850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.903514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.918213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 796/1575] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:50.918213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:50.925569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe12ea2-430a-4359-98a1-89c47ee96c45 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.964305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682d953-d32e-4e76-8384-3dd962fbcdd0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:50.969586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.970219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.970501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.970764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.971427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.973379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:50.993070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:50.993800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:50.994122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:50.994348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:50.995015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:50.996960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56fe55-788d-4040-b077-476cd267ec11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.001865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 780/1576] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.002686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.022401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 797/1577] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:50 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.022401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.022401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.022401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.040695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:51.042335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:51.071189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb81ed-4380-4917-9aa6-c1c6503c9676 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.075769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.076390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.076697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.076967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.077664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.079424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:51.079647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.114541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 781/1578] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.114541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.114874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 798/1579] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:51.114874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.124089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0ab8-a8ea-4c38-a0a7-53cd78da8dab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.157572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:51.183026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94ead-4697-474f-9e27-168fe93b888c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.188438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.189144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.189427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.189562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.189685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.190118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.190382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.190507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.190671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.191394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.192299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.193351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.216099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 799/1580] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.216972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.220772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 782/1581] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.220772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.229156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187a08-211e-4646-a270-45ad2b8a0e11 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.231939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e4a1b-9f3f-4497-9e5a-e4cb30a26338 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.234316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.234939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.235249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.235529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.236190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.236935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.237548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.237824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.238093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.238439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.238776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.240356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.253338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 783/1582] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.254360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.266986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7a603-d644-483a-a45e-bf0b5746e2a8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.269169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 800/1583] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/users => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.269908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.274509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.275132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.275409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.275733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.276411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.278456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.279900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77489-e0fc-4085-afad-8a35a41b87e0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.286676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.287451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.287737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.288020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.288743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.290343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.301452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 801/1584] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.302271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.310217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 784/1585] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/users => generated 279 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.311032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.315019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:51.315409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37523-ecd7-483d-b927-778ede6871e1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.320141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.320808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.321096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.321367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.322040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.323978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.350971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 802/1586] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:51.350971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.360723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c33c9-8d9e-4d60-8899-adac00e9a239 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.366577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.367193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.367465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.367739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.368420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.370096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.383983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 803/1587] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.383983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.389944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8536c7-3306-443d-866d-bba083872f70 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.394782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.395474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.395714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.396178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.396799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053a98-70e7-4bd9-a8c1-48f82e291756 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.401675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.402313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.402591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.402860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.403556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.405187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.408692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.410072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.422224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 785/1589] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:51.422478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 804/1589] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.423043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.423851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.434656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cacd33-c27a-4d75-bd0a-bc9aeb23e7a3 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.435673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e28a-4586-4bd9-9b2f-c30b5ceb2ae5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.440784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.441698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.442054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.442296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] PATH_INFO: `/v3/projects/b5cdc499d1714943b9b4907ce9989ab8/users/083ed135697a4b78a64a1bc0dd54da71/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.447029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.447895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.448204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.452830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.454673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.456630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.461718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cdc499d1714943b9b4907ce9989ab8, user_id=083ed135697a4b78a64a1bc0dd54da71, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.465072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.468257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 805/1590] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.470821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.483170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 786/1591] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:51 2022] PUT /identity/v3/projects/b5cdc499d1714943b9b4907ce9989ab8/users/083ed135697a4b78a64a1bc0dd54da71/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:51.483545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeceb3-b13f-4f02-8568-1348758460a0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.484837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.559025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:51.568422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbbcc9-5aff-40dd-88d7-2c7d079d4143 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.573772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.574648 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.575107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.575568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.576521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.577404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.578839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.579264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.579718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.579925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.580938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.584542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.595928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 787/1592] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.595928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.612116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 806/1593] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.613123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef4dbd-a5e8-434f-a61d-aec27ca98014 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.613502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.621573 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.622327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.622709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.623081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.623941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.626265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.627904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966877-5aaa-4457-ae79-43c3902b2025 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.632898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:51.638560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.639789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.640393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.641533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.642587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 788/1594] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.643130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.643655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.646219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.654404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271c412-52a3-4c1c-94de-ea17be38c0f8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.659374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.660021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.660408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.660817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.661619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.663453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2fee4-9bde-473f-ba14-22e4aec20f98 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.672445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 807/1595] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.672445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.684462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 789/1596] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.684462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.684462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.685208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c057c6-11c6-4e17-9cf7-eba050bdecb8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.685324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.689524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.690251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.690779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.691242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.692089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.693813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.710596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 808/1597] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.710596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.720222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] MFA Rules not processed for user `083ed135697a4b78a64a1bc0dd54da71`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:51.721287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e983c-5ed1-400d-a14a-12ad41daa681 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.721496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:51.726130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.727068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.727355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.727623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.728382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.730127 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.748522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 809/1598] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.750347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.763208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3f3d6-2233-4eb7-97b4-a15e436d424b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.774700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.775387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.775674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.775924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] PATH_INFO: `/v3/projects/65e192db1854491385622aa1f662ce01/users/a860865d5e1d40d1ad658d0e9b65f5a9/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.791152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e192db1854491385622aa1f662ce01, user_id=a860865d5e1d40d1ad658d0e9b65f5a9, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.793969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.807965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 790/1599] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:51.809378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.814108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 810/1600] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:51 2022] PUT /identity/v3/projects/65e192db1854491385622aa1f662ce01/users/a860865d5e1d40d1ad658d0e9b65f5a9/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:51.814938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.824575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d46db-7e4f-4fc3-abf4-e4d76331ff05 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.911962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bf695-4646-4f08-b46b-a213af873886 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.917560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.918536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.918954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.919318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] PATH_INFO: `/v3/projects/c1c619ab10a94b95b8abf82f3775a971/users/343be19d43aa42a9a0ac7bb88b12e425/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.921546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:51.923235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:51.923739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:51.924738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:51.925973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.928994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.940365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c619ab10a94b95b8abf82f3775a971, user_id=343be19d43aa42a9a0ac7bb88b12e425, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:51.943671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:51.946424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 791/1601] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:51.947442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:51.962547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4127-4a22-41e5-8bf2-c62a3268a1e3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:51.966690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 811/1602] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:51 2022] PUT /identity/v3/projects/c1c619ab10a94b95b8abf82f3775a971/users/343be19d43aa42a9a0ac7bb88b12e425/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:51.967667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.032877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.034074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.034074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.034074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] PATH_INFO: `/v3/projects/e5e06686b8844882abe52291672cab90/users/4f68657a55414ec39a27136701c41936/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.037793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ada8c-ab74-4fe1-9b3c-2fe4ed467677 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.043244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.043913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.044193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.044452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] PATH_INFO: `/v3/projects/c0feea87e98143df8275d08da70c8bc0/users/8930fde86d814c8a9e68c5f7374a4b40/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.051308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e06686b8844882abe52291672cab90, user_id=4f68657a55414ec39a27136701c41936, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:52.054013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:52.060296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0feea87e98143df8275d08da70c8bc0, user_id=8930fde86d814c8a9e68c5f7374a4b40, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:52.063275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2550-2e92-42ae-8f7e-2d9c2332eea7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:52.063886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:52.066682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:52.072756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 792/1603] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:51 2022] PUT /identity/v3/projects/e5e06686b8844882abe52291672cab90/users/4f68657a55414ec39a27136701c41936/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:52.074062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.081497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 812/1604] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:51 2022] PUT /identity/v3/projects/c0feea87e98143df8275d08da70c8bc0/users/8930fde86d814c8a9e68c5f7374a4b40/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:52.086093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cbb1-5a44-4f3b-86e4-9f0c8f8d9c54 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.086378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cbb1-5a44-4f3b-86e4-9f0c8f8d9c54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.086647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cbb1-5a44-4f3b-86e4-9f0c8f8d9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.125428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1872cbb1-5a44-4f3b-86e4-9f0c8f8d9c54 None None] MFA Rules not processed for user `a860865d5e1d40d1ad658d0e9b65f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.126680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1872cbb1-5a44-4f3b-86e4-9f0c8f8d9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.180454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ea37-3f79-48a3-8fda-d9d958217fc9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.213737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 813/1605] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.213737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e63ae-b443-414f-b25f-89990e4670e6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.213737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e63ae-b443-414f-b25f-89990e4670e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.213737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e63ae-b443-414f-b25f-89990e4670e6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.214672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 814/1606] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jul 28 06:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:11:52.215522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e63ae-b443-414f-b25f-89990e4670e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.275251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.276269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.276745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.277233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] PATH_INFO: `/v3/projects/8ba9d0f25d164349bb01da3dce4b940b/users/4f3af7b04a3344b7bbbee8b1d6199de4/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.307877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba9d0f25d164349bb01da3dce4b940b, user_id=4f3af7b04a3344b7bbbee8b1d6199de4, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:52.311845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59de8d-2d91-4dd2-b397-83e8e1434dbb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:52.316284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e63ae-b443-414f-b25f-89990e4670e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.322577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.324231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.324509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.324805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] PATH_INFO: `/v3/projects/1dbc3af7d008438f866cb2e706aeea2a/users/f24899568c1b483fbf10a06ccf43d5bd/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.334266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 793/1607] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:52 2022] PUT /identity/v3/projects/8ba9d0f25d164349bb01da3dce4b940b/users/4f3af7b04a3344b7bbbee8b1d6199de4/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:52.335865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadc0a-308c-4ad4-a3b0-fac2a6e9c354 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.336152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadc0a-308c-4ad4-a3b0-fac2a6e9c354 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.336424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadc0a-308c-4ad4-a3b0-fac2a6e9c354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.355303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbc3af7d008438f866cb2e706aeea2a, user_id=f24899568c1b483fbf10a06ccf43d5bd, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:52.360025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900c03-026a-4d12-b951-7a6bb2fced1f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:52.364816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16fadc0a-308c-4ad4-a3b0-fac2a6e9c354 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.367120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16fadc0a-308c-4ad4-a3b0-fac2a6e9c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.398711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 815/1608] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:52 2022] PUT /identity/v3/projects/1dbc3af7d008438f866cb2e706aeea2a/users/f24899568c1b483fbf10a06ccf43d5bd/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:52.398711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.398711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.398711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.422957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.425402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.464917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 794/1609] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.464917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94026f6-c861-41c6-86f1-1563ea72fe3c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.464917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94026f6-c861-41c6-86f1-1563ea72fe3c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.465466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94026f6-c861-41c6-86f1-1563ea72fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.501355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d94026f6-c861-41c6-86f1-1563ea72fe3c None None] MFA Rules not processed for user `8930fde86d814c8a9e68c5f7374a4b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.502827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d94026f6-c861-41c6-86f1-1563ea72fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.508743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 816/1610] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.508743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.520266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa3734-ade6-44d4-b5c3-d09b853a4a56 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.533801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:52.538374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.539834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.540426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.541662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.542740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:52.545982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bf19-ae91-4da0-b4b6-bb58a487f36f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:52.557524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:52.602572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 795/1611] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.602572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.602572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.602572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.604245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 817/1612] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:52.606052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe187c6-b530-4e7f-83e5-7f58a595892f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.606647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe187c6-b530-4e7f-83e5-7f58a595892f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.607451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe187c6-b530-4e7f-83e5-7f58a595892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.656622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ebe187c6-b530-4e7f-83e5-7f58a595892f None None] MFA Rules not processed for user `4f3af7b04a3344b7bbbee8b1d6199de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.657929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ebe187c6-b530-4e7f-83e5-7f58a595892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.677273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.679101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.765223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 818/1613] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.767344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.767644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.767908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.811347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] MFA Rules not processed for user `f24899568c1b483fbf10a06ccf43d5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:52.812938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:52.820322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 796/1614] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.821831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.903261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c28fe6-2d53-4403-9e0d-60d73ae352fb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.909421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.910613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.910991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.911527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 819/1615] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:52.927035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:52.955453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967299d4-0047-4ea8-8b29-290f3f882172 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:52.965338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:52.965990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:52.968139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:52.969462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:52.985276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:53.007235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.009433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.026631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 797/1616] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:53.027610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.039617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8adf-fe7a-47f5-a488-ad1674b5f05d service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.046045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.047316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.047729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.048525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.049636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.053133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.091433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.093206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.106646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:53.108414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 798/1617] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:53.109371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.116393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 820/1618] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:53.117198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.130916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae8224-a3dc-45d5-9450-854a9a896c91 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.252758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46a6b-828c-4c8f-aece-820a7b0a37af admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.259307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.259959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.260248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.260517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.261192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.261350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.262942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.263297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.263458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.263628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.264711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.270739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c58a-377f-48d6-9643-75809bfe2e2f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.309071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 799/1619] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:53.310016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.337064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 821/1620] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/projects => generated 357 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:53.340230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e64b-6f0f-4608-b41a-975c005b0782 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.340558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e64b-6f0f-4608-b41a-975c005b0782 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.340871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990e64b-6f0f-4608-b41a-975c005b0782 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.342454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 822/1621] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jul 28 06:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:11:53.344401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990e64b-6f0f-4608-b41a-975c005b0782 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.461588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32255e-2c20-4122-b0e2-6e6f77a75073 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.487549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990e64b-6f0f-4608-b41a-975c005b0782 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.505543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.506245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.506525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.506845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.507567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.509590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.553465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:53.561121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 823/1622] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/users => generated 309 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:53.562136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.579493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4a73-d3db-4f56-b881-334fdee7a17e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.583695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.584977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.585516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.586076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.592050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.592906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.593354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.593811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.594792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.597384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.613822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 824/1623] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:53.614882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.686635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3653a4-3202-4069-b802-9c2ed0375502 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.686635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.686635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.686635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f1bda-d7e6-4de4-9384-3ac437a8889d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 825/1624] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.689427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.690204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.722789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:53.724539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:53.764482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 826/1625] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jul 28 06:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:53.765535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.783710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.785928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.792942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945b074-92f4-4530-8c9b-e57220da407d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.803024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 800/1626] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:53.803692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.805848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.806482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.806754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.807019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.807711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.809355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.825600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 827/1627] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:53.826568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.849251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596b05-bd46-42c9-acfe-93dc8f9aed35 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.850986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5fde1-4c99-46c5-876b-672cea6f8b66 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.856745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.857472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.857826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.858167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.858995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.861402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.866689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.869460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.870523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.872423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] PATH_INFO: `/v3/projects/e610d6af11ed4752999c8ce555ee4d0e/users/ba772e8d86d5494eb80cfd8ec2bb09b8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.876908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 828/1628] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:53.876908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.889609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce908-7f31-4e36-9f27-e420ae447289 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:53.896192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:53.896986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:53.897365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:53.897703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:53.914646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:53.916433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e610d6af11ed4752999c8ce555ee4d0e, user_id=ba772e8d86d5494eb80cfd8ec2bb09b8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:53.922765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:53.952960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 801/1629] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:53 2022] PUT /identity/v3/projects/e610d6af11ed4752999c8ce555ee4d0e/users/ba772e8d86d5494eb80cfd8ec2bb09b8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:53.953894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:53.999902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.002580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.029937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 829/1630] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:54.031711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.050484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a829f6-5dcb-4105-8eaa-50abb841588b service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.073068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f4c8f-07bd-4ee8-90ef-733f2a41bc0b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.079442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.080400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.080905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.081522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] PATH_INFO: `/v3/projects/c707bb16baf54316a0157da4765af91d/users/7cd66bad680f455090818b72f78459a5/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.107312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c707bb16baf54316a0157da4765af91d, user_id=7cd66bad680f455090818b72f78459a5, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.112049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.134285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 802/1631] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:53 2022] PUT /identity/v3/projects/c707bb16baf54316a0157da4765af91d/users/7cd66bad680f455090818b72f78459a5/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:54.138536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.141191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.142565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.142866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.143175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] PATH_INFO: `/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8/users/d4bc36c5f1fd4163adccde78d1295381/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.182870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c19da6d0ec4bd2baafe078abef1ca8, user_id=d4bc36c5f1fd4163adccde78d1295381, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.186654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.216364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 830/1632] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:54 2022] PUT /identity/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8/users/d4bc36c5f1fd4163adccde78d1295381/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:54.217865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.256482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:54.284823 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccdcca-54fa-4b43-9194-bc54f791efee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.340688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77675-c7e0-4ccb-b832-0c9dd5201af8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.347308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.348660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.348965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.349247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.350163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.351818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.410664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 831/1633] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:54.411832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.417256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.417909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.418190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.418459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.419202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.425153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d581770-5368-49c3-a216-73efd4e9113c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.442667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f175756-8d78-42f6-8278-de889fa5d9f3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.446852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 803/1634] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:54.448183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36a8f-773a-477d-a3f9-74e47c1d5868 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.448471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36a8f-773a-477d-a3f9-74e47c1d5868 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.448774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36a8f-773a-477d-a3f9-74e47c1d5868 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.457986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.458354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.463225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 804/1635] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jul 28 06:11:54 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:11:54.463410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.463712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.464264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36a8f-773a-477d-a3f9-74e47c1d5868 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.464450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.466375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.490454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 832/1636] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:11:54.490454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.493273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36a8f-773a-477d-a3f9-74e47c1d5868 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.505167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.505884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.506171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.506452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] PATH_INFO: `/v3/projects/c707bb16baf54316a0157da4765af91d/users/7cd66bad680f455090818b72f78459a5/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.514333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c707bb16baf54316a0157da4765af91d, user_id=7cd66bad680f455090818b72f78459a5, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.525302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224415-0f7a-4758-b0f5-556564aa4e4f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.530199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350f5e2-63fc-4536-89ba-0c03ea1d1acf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.545178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.545885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.546173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.546454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] PATH_INFO: `/v3/projects/e610d6af11ed4752999c8ce555ee4d0e/users/ba772e8d86d5494eb80cfd8ec2bb09b8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.552714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 805/1637] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:54 2022] PUT /identity/v3/projects/c707bb16baf54316a0157da4765af91d/users/7cd66bad680f455090818b72f78459a5/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:54.553950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e610d6af11ed4752999c8ce555ee4d0e, user_id=ba772e8d86d5494eb80cfd8ec2bb09b8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.563652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e383-1404-4b2e-a507-dbab6d574f0c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.563991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e383-1404-4b2e-a507-dbab6d574f0c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.564315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9e383-1404-4b2e-a507-dbab6d574f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.564786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.594074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-eae9e383-1404-4b2e-a507-dbab6d574f0c None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:54.595248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eae9e383-1404-4b2e-a507-dbab6d574f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:54.624150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 833/1638] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:54 2022] PUT /identity/v3/projects/e610d6af11ed4752999c8ce555ee4d0e/users/ba772e8d86d5494eb80cfd8ec2bb09b8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:54.633533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:54.666106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:54.725005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 806/1639] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:54.726149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.726436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.726706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.801053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] MFA Rules not processed for user `7cd66bad680f455090818b72f78459a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:54.802339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:54.817473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7efc1-600e-4586-b710-e91c9f5e7788 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:54.825609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:54.826332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.826616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.826893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] PATH_INFO: `/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8/users/d4bc36c5f1fd4163adccde78d1295381/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.833325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c19da6d0ec4bd2baafe078abef1ca8, user_id=d4bc36c5f1fd4163adccde78d1295381, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:54.836974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da1ee7-45fa-48a7-a379-e54721351b2e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:54.856697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 834/1640] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:11:54 2022] PUT /identity/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8/users/d4bc36c5f1fd4163adccde78d1295381/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:54.858618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b285dd-9e5c-4367-9a2a-347a5705b2b7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.858909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b285dd-9e5c-4367-9a2a-347a5705b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.859219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b285dd-9e5c-4367-9a2a-347a5705b2b7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.865892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 835/1641] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jul 28 06:11:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:11:54.869195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915047-4f75-4eaf-814a-fc661baefad9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:54.870103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915047-4f75-4eaf-814a-fc661baefad9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:54.870443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9915047-4f75-4eaf-814a-fc661baefad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:54.926803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e9915047-4f75-4eaf-814a-fc661baefad9 None None] MFA Rules not processed for user `ba772e8d86d5494eb80cfd8ec2bb09b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:54.929304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9915047-4f75-4eaf-814a-fc661baefad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:54.970050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:54.998628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 807/1642] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:54.999606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:55.029722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 836/1643] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:55.032666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96ff9-7cdc-416c-859a-d53773311a7d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:55.032970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96ff9-7cdc-416c-859a-d53773311a7d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:55.033239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96ff9-7cdc-416c-859a-d53773311a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:55.072584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07c96ff9-7cdc-416c-859a-d53773311a7d None None] MFA Rules not processed for user `d4bc36c5f1fd4163adccde78d1295381`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:55.074414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07c96ff9-7cdc-416c-859a-d53773311a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:55.119426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b991f5-1068-4dd7-adfe-346f2427f313 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:55.229932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 837/1644] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:55 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:55.235435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:55.235435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:55.237182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:55.243805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:55.244455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:55.244761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:55.245038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:55.289554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:55.292384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:55.326440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:55.411400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:55.412971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:55.437082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 808/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:55.440760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:55.458529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5f7-5c87-4e12-8930-ff32c2204619 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:55.470527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:55.471185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:55.471460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:55.471739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:55.484186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 838/1646] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:11:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:55.596463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:55.622027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:55.623493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:55.650926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 809/1647] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:55.826512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:55.841087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5fbf4-fc00-40e5-860c-f199acc3a86c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:55.860194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:55.860869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:55.861154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:55.861428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:55.888287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:55.892579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:55.916787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 839/1648] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:56.017025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:56.030975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4ea6-beec-4edf-9cdf-dd8c9669432c service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:56.038306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:56.039074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:56.039408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:56.039689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:56.058917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:56.061349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:56.096935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 810/1649] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:56 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:56.148371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:56.157631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca1dec-c1fb-47d0-83d6-3ee5fc75d617 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:56.167175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:56.167972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:56.168144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:56.168539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:56.202401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:56.204490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:56.235389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 840/1650] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:56.637579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:56.657423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe1b8-992f-4734-9eb7-b2d70e5c7b95 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:56.675638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:56.676502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:56.679033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:56.679870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:56.797242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:56.805324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a32f85-1b9b-40f1-80a2-ba7e4059e1cc service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:56.826953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:56.831566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:56.834503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:56.834830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:56.877729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:56.879127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:56.907535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 811/1651] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:57.002827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:57.010388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:57.057465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 841/1652] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:11:57.423535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:57.510982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:57.576127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653686b6-f807-4dbd-9a89-73af5bd1b4f4 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:57.587386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:57.589043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:57.589531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:57.590006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] PATH_INFO: `/v3/users/f24899568c1b483fbf10a06ccf43d5bd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:57.592260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24899568c1b483fbf10a06ccf43d5bd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:57.593740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: WARNING py.warnings [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:11:57.593740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: warnings.warn(msg) Jul 28 06:11:57.593740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: Jul 28 06:11:57.595453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:57.688833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fe53-3c0b-4bf7-9d06-16051705eb46 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:57.694994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:57.695804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:57.696237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:57.696613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] PATH_INFO: `/v3/users/8930fde86d814c8a9e68c5f7374a4b40` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:57.697926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8930fde86d814c8a9e68c5f7374a4b40)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:57.700088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:57.757002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:57.789248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24899568c1b483fbf10a06ccf43d5bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.817554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24899568c1b483fbf10a06ccf43d5bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.819149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24899568c1b483fbf10a06ccf43d5bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.845032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8930fde86d814c8a9e68c5f7374a4b40'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.845556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24899568c1b483fbf10a06ccf43d5bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.847542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8930fde86d814c8a9e68c5f7374a4b40'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.869263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:11:57.886709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c366a3b-0bcf-42f0-9e86-f57f8fcb508f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24899568c1b483fbf10a06ccf43d5bd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.887477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8930fde86d814c8a9e68c5f7374a4b40'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.902283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 812/1653] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:11:57 2022] DELETE /identity/v3/users/f24899568c1b483fbf10a06ccf43d5bd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:11:57.904079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:57.904553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:57.906034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:57.922738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8930fde86d814c8a9e68c5f7374a4b40'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.925042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-20a5e5c9-dd74-4c03-88e7-f721ebea0412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8930fde86d814c8a9e68c5f7374a4b40'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:11:57.956824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 842/1654] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:11:57 2022] DELETE /identity/v3/users/8930fde86d814c8a9e68c5f7374a4b40 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:11:57.961975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:57.962533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:57.962799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:57.967413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:57.973579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:58.054836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:58.059300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:58.128112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 813/1655] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:58.139410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:58.141184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:58.282998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 843/1656] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:58.301643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:58.316367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce1402-9b68-4093-9af1-b3ccabc689fe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:58.324396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164af8-c050-44af-bb43-c25a99d6478b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:58.332903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:58.333117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:58.333558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:58.333922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:58.334205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:58.336376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:58.339027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:58.340448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:58.361053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:58.362523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400e7de-b063-45b0-9afe-f48fd9521006 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:58.391919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:58.400009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:58.409387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 814/1657] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:11:58.415737 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:58.416991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:58.417972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:58.450437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 844/1658] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:11:58.524683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] MFA Rules not processed for user `0db6c2215b304cb3af3aebc565d55278`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:11:58.524683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:58.699432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 815/1659] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:11:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:11:58.715729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:11:58.717148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:11:58.958673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219889cc-2f43-4686-83a8-538c533ec802 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:11:59.002335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:11:59.006358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:11:59.007877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:11:59.008906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:11:59.053509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:11:59.059328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:11:59.118712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 845/1660] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:11:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:00.185846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:00.187103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:00.231779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc322a3-7163-4cc8-8c63-a9ecdfd5f75a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:00.259300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:00.260740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:00.261210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:00.261668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] PATH_INFO: `/v3/projects/c0feea87e98143df8275d08da70c8bc0` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:00.265061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0feea87e98143df8275d08da70c8bc0)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:00.268143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:00.434654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:00.438866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:00.454181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:00.473464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52353-43b2-4607-b0de-5d80d6fbfd6d service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:00.496568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:00.497266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:00.497550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:00.497823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] PATH_INFO: `/v3/projects/1dbc3af7d008438f866cb2e706aeea2a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:00.500680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbc3af7d008438f866cb2e706aeea2a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:00.501876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:12:00.501876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jul 28 06:12:00.501876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: Jul 28 06:12:00.506411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:00.529761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:00.591550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0feea87e98143df8275d08da70c8bc0', 'request_id': 'req-ee888d83-f240-43d6-a34d-5e030cb738ed'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.628143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0feea87e98143df8275d08da70c8bc0', 'request_id': 'req-ee888d83-f240-43d6-a34d-5e030cb738ed'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.671254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0feea87e98143df8275d08da70c8bc0', 'request_id': 'req-ee888d83-f240-43d6-a34d-5e030cb738ed'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.684360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbc3af7d008438f866cb2e706aeea2a', 'request_id': 'req-dec35f73-e266-4c42-964d-a20ce26f533e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.712077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbc3af7d008438f866cb2e706aeea2a', 'request_id': 'req-dec35f73-e266-4c42-964d-a20ce26f533e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.732098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbc3af7d008438f866cb2e706aeea2a', 'request_id': 'req-dec35f73-e266-4c42-964d-a20ce26f533e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.739470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] The token cache is being invalidate because project c0feea87e98143df8275d08da70c8bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:00.739955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.745886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.756452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 816/1661] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:00 2022] DELETE /identity/v3/projects/c0feea87e98143df8275d08da70c8bc0 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:00.760373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:00.769755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:00.794615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] The token cache is being invalidate because project 1dbc3af7d008438f866cb2e706aeea2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:00.794615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.796428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dec35f73-e266-4c42-964d-a20ce26f533e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:00.811894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 846/1662] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:00 2022] DELETE /identity/v3/projects/1dbc3af7d008438f866cb2e706aeea2a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:00.817679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782628-297a-4013-8474-6b443bc587c6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:00.818438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782628-297a-4013-8474-6b443bc587c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:00.819038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782628-297a-4013-8474-6b443bc587c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:00.924998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-24782628-297a-4013-8474-6b443bc587c6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:00.935593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24782628-297a-4013-8474-6b443bc587c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:01.182374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888d83-f240-43d6-a34d-5e030cb738ed admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:01.294513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 847/1663] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:01.307533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:01.307827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:01.308104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:01.405541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:01.407065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:01.446898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 848/1664] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:01.450175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:01.472472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:01.475997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:01.478919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:01.479640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] PATH_INFO: `/v3/users/7cd66bad680f455090818b72f78459a5` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:01.486217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd66bad680f455090818b72f78459a5)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:01.486980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e141f6-a7cd-41f5-9339-44d6a1b57dba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:01.493240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:01.501848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:01.503911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:01.506288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:01.506925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:01.509617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:01.513081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:01.527254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:01.602634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 849/1665] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:01.609488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:01.658525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd66bad680f455090818b72f78459a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:01.661133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ba0-2f61-4535-9ab3-51de012e17ad admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:01.685810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:01.689958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:01.690402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:01.690603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd66bad680f455090818b72f78459a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:01.690843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:01.691408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd66bad680f455090818b72f78459a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:01.691981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:01.701677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:01.710096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:01.718500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd66bad680f455090818b72f78459a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:01.773015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd66bad680f455090818b72f78459a5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:01.803276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 817/1666] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:00 2022] DELETE /identity/v3/users/7cd66bad680f455090818b72f78459a5 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:01.825525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 850/1667] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:01 2022] POST /identity/v3/projects => generated 405 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:01.829966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:01.832527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:02.059472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4dca-5bce-4bb7-adfc-5735af69f58f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:02.205440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:02.206087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.206372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.206651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.207346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:02.209767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:02.264843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:02.265077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 818/1668] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:01 2022] POST /identity/v3/users => generated 303 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:02.293336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e29-10d1-4851-becb-5b21b13e715e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:02.305898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:02.306810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.307234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.307662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.308505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:02.310300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:02.354024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:02.368899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 851/1669] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:02.368996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e053ad-5909-456f-a92c-bbdff3413911 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:02.372395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:02.374629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.374629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.374629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.374629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:02.376399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086b16a-e7a6-43f5-8dbc-6fea5e8eb845 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:02.394514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:02.403580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 819/1670] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:02.409287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a928-65e4-40e3-8e04-6ac4b7feaef2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:02.416937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:02.418114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.418708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.418941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] PATH_INFO: `/v3/projects/eb16847750be4c3db08bc34a90e68c27/users/5629e8fccf804d0795a55b0d8b6892c1/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.466381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb16847750be4c3db08bc34a90e68c27, user_id=5629e8fccf804d0795a55b0d8b6892c1, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:02.471690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:02.518989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 852/1671] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:02 2022] PUT /identity/v3/projects/eb16847750be4c3db08bc34a90e68c27/users/5629e8fccf804d0795a55b0d8b6892c1/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:02.520938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a0be-d5a2-4ea6-96ea-04829f932f52 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.521452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a0be-d5a2-4ea6-96ea-04829f932f52 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.521452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54a0be-d5a2-4ea6-96ea-04829f932f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.570014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3a54a0be-d5a2-4ea6-96ea-04829f932f52 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:02.571321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3a54a0be-d5a2-4ea6-96ea-04829f932f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:02.708838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:02.749495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 820/1672] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:02.793577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:02.796224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:02.823186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:02.897964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955bbc0-a001-4180-b65c-5ed1ebbe06f4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:02.902278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:02.903350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:02.903803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:02.904216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:02.918985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:02.921414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:02.937867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 853/1673] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:04.257460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f16a-1884-456c-a27a-15261b45e109 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:04.257979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f16a-1884-456c-a27a-15261b45e109 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:04.258059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f16a-1884-456c-a27a-15261b45e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:04.275322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:04.277201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:04.319948 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1619-7ae0-4087-b471-7a1622f8f759 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:04.350574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1178f16a-1884-456c-a27a-15261b45e109 None None] MFA Rules not processed for user `0db6c2215b304cb3af3aebc565d55278`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:04.353456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:04.357192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:04.357488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1178f16a-1884-456c-a27a-15261b45e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:04.359743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:04.361103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] PATH_INFO: `/v3/projects/c707bb16baf54316a0157da4765af91d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:04.365486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c707bb16baf54316a0157da4765af91d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:04.379532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:04.578630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c707bb16baf54316a0157da4765af91d', 'request_id': 'req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:04.595200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c707bb16baf54316a0157da4765af91d', 'request_id': 'req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:04.604300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 821/1674] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:04.626502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c707bb16baf54316a0157da4765af91d', 'request_id': 'req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:04.667514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] The token cache is being invalidate because project c707bb16baf54316a0157da4765af91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:04.667809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:04.671006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2f1cfec0-74dc-440f-bed7-ad45cec1d3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:04.681820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 854/1675] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:04 2022] DELETE /identity/v3/projects/c707bb16baf54316a0157da4765af91d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:04.683609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:04.684189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:04.684682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:04.722682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:04.726347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:04.953884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 822/1676] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:04.953981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:04.953981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:04.953981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.007878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:05.009406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:05.038113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 855/1677] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:05.043043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:05.056884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0721282-3825-4812-b470-7fd0959a1848 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:05.075731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:05.076422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.078505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.078505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.078505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:05.078789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:05.084342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:05.131768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:05.145984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 823/1678] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:05.161603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362cc1f-534b-48e3-a770-c1ce8f9a9a7e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:05.190152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:05.190941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.194549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.195163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.196012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:05.204659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:05.245260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:05.248840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:05.277106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c024c-876b-4faa-8da8-fd72d589ebfb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:05.284829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:05.286409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.286840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.287895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] PATH_INFO: `/v3/users/083ed135697a4b78a64a1bc0dd54da71` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.292784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083ed135697a4b78a64a1bc0dd54da71)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:05.298339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:05.333989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 856/1679] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:05 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:05.342981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:05.427123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083ed135697a4b78a64a1bc0dd54da71'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:05.453858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083ed135697a4b78a64a1bc0dd54da71'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:05.455209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083ed135697a4b78a64a1bc0dd54da71'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:05.502750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083ed135697a4b78a64a1bc0dd54da71'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:05.563015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4908beb1-0bb7-46da-b6fe-837935666ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083ed135697a4b78a64a1bc0dd54da71'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:05.584026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 824/1680] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:05 2022] DELETE /identity/v3/users/083ed135697a4b78a64a1bc0dd54da71 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:05.585940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8783e-f6e8-4524-a765-817aa7fcf56b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.586742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec297fe-e3f0-4e0f-a8ec-5d8ce739bccb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:05.587803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8783e-f6e8-4524-a765-817aa7fcf56b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.587803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8783e-f6e8-4524-a765-817aa7fcf56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.610489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:05.627966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-89c8783e-f6e8-4524-a765-817aa7fcf56b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:05.629626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-89c8783e-f6e8-4524-a765-817aa7fcf56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:05.640832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:05.742741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:05.743316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.743602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.743867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.744792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:05.746976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:05.768789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 825/1681] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:05.798996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:05.799282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:05.799557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:05.855408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 857/1682] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:05 2022] POST /identity/v3/users => generated 289 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:05.860595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:05.865173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:05.894316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] MFA Rules not processed for user `5629e8fccf804d0795a55b0d8b6892c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:05.905148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:06.027855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c774f1-4393-48eb-bca7-b8503d14daad admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.038742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.039231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.039505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.040691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.065430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.081747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.104466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 826/1683] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:06.106890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.108331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 858/1684] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:06.110250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.112027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:06.118395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:06.133953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2f29-07d0-4a07-91bc-dc15a1835b76 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.137651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ad44-00ec-45c4-93af-c35c0b1b1f9e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.141376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.142033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.142432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.142694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.143372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.145672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.146733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.147148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.147558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.148692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.149477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.150616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.169426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 827/1685] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:06.173711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.191867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66d01-a5d6-4b41-8d87-c25198bf5356 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.202117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.204848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.205656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.206302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.207249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.209199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.211741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 859/1686] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:06 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:06.215890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.231723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 828/1687] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:06.235907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.263640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde0973-e55d-4672-a5cc-12349879aad1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.362028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451454fb-b7e2-4050-8e8b-b9e1a3062e3f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.372803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.374495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.374892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.375390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.376413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.381269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba1f1a-716e-42dc-9f57-e839dc415930 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.426792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 860/1688] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:06 2022] POST /identity/v3/users => generated 308 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:06.431797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad566-ffd1-46d8-b810-7c6870727ba8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.433002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad566-ffd1-46d8-b810-7c6870727ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.433577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad566-ffd1-46d8-b810-7c6870727ba8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.436789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 861/1689] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jul 28 06:12:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:06.448067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfad566-ffd1-46d8-b810-7c6870727ba8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.480572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.482562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.484609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.485300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] PATH_INFO: `/v3/projects/e2e8a8b290b84ead9eb3fb967ff9937c/users/88d1a9e0104d431fbffcd217456c2350/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.488555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfad566-ffd1-46d8-b810-7c6870727ba8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.503378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.504662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.505011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.506224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.507080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.511369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09df9d-0ecd-4eea-803d-19d7b3adcaa9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.527287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e8a8b290b84ead9eb3fb967ff9937c, user_id=88d1a9e0104d431fbffcd217456c2350, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.533097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.547736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 862/1690] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:06.557005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:06.557633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.559827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.561292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.602955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 829/1691] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:06 2022] PUT /identity/v3/projects/e2e8a8b290b84ead9eb3fb967ff9937c/users/88d1a9e0104d431fbffcd217456c2350/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:06.612018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.612018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:06.641802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:06.711781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:06.716311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:06.830467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd954f2-a914-4c52-b613-b0bec37eff9c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.836607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.837549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.837827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.838096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] PATH_INFO: `/v3/users/a860865d5e1d40d1ad658d0e9b65f5a9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.842558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a860865d5e1d40d1ad658d0e9b65f5a9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.846510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:06.887751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 863/1692] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:12:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:06.891036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:06.916022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09a4f6-95d3-4f1d-a56f-e6efc12ea394 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:06.943377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:06.944077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:06.944361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:06.944652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] PATH_INFO: `/v3/projects/c3f1746adec44a889c67fff787d11b70/users/0a30548bd6834548939706fb60fff231/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:06.959995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a860865d5e1d40d1ad658d0e9b65f5a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:06.982435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a860865d5e1d40d1ad658d0e9b65f5a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:06.982922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f1746adec44a889c67fff787d11b70, user_id=0a30548bd6834548939706fb60fff231, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:06.984796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a860865d5e1d40d1ad658d0e9b65f5a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:06.986243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941c5aa-15a5-40e1-a465-dd17d5f2edd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:07.009530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a860865d5e1d40d1ad658d0e9b65f5a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.020210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 864/1693] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:06 2022] PUT /identity/v3/projects/c3f1746adec44a889c67fff787d11b70/users/0a30548bd6834548939706fb60fff231/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:07.027204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.027549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.027761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.044411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a860865d5e1d40d1ad658d0e9b65f5a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.064374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 830/1694] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:06 2022] DELETE /identity/v3/users/a860865d5e1d40d1ad658d0e9b65f5a9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:07.066524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.072482 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.089740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] MFA Rules not processed for user `88d1a9e0104d431fbffcd217456c2350`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:07.090921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.226069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69626dfc-819e-4b51-af8b-b609622cafee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:07.241092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:07.242164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.242676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.243000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.247961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.256699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 865/1695] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:07.257590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.262854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.270250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:07.272429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b29ae9-0a09-47cd-bb54-1dea7b203c2f service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:07.283661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 831/1696] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:07.285630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.285920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.286196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.316828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:07.318063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.338233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:07.433569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7d964-2c20-4356-ab9f-2b6f8b591d17 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:07.440319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:07.441136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.441526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.441926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.443333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:07.445767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:07.480284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 866/1697] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:07.480284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.485730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.500741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 832/1698] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:07.505164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.506667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed44a4-348a-46c0-8a23-d9638013b4fd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:07.512672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.519410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:07.520076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.520356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.520629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] PATH_INFO: `/v3/projects/b5cdc499d1714943b9b4907ce9989ab8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.521851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cdc499d1714943b9b4907ce9989ab8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:07.523762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:07.539156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:07.540296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98649fd5-f1b0-4e16-89fe-0baca18feebc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:07.560371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:07.561239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.561915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.562661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.562867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:07.564980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982902d-31cc-4339-94c2-f074867ea0d6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:07.642841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cdc499d1714943b9b4907ce9989ab8', 'request_id': 'req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.645324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 833/1699] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:07 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:07.647797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:07.650459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:07.651632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:07.662960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cdc499d1714943b9b4907ce9989ab8', 'request_id': 'req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.678628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cdc499d1714943b9b4907ce9989ab8', 'request_id': 'req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.708590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] The token cache is being invalidate because project b5cdc499d1714943b9b4907ce9989ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:07.709240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.713835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:07.716998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 867/1700] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:07 2022] DELETE /identity/v3/projects/b5cdc499d1714943b9b4907ce9989ab8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:07.719502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.723288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.733089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] MFA Rules not processed for user `343be19d43aa42a9a0ac7bb88b12e425`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:07.737522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:07.937538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a58ee-834b-4ed7-8f8e-b3097fc27e71 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:07.960473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 834/1701] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:07.964851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:07.972973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.130590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.134877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.135657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.135926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] PATH_INFO: `/v3/projects/c3f1746adec44a889c67fff787d11b70/users/0a30548bd6834548939706fb60fff231/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.142926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f1746adec44a889c67fff787d11b70, user_id=0a30548bd6834548939706fb60fff231, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.147958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6533c-91e1-4c91-8632-a9dd25052e1b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:08.150230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:08.158889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.159549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.159830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.160105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.171474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.180080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 868/1702] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:07 2022] PUT /identity/v3/projects/c3f1746adec44a889c67fff787d11b70/users/0a30548bd6834548939706fb60fff231/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:08.182278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:08.187391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.209009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.213282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df673e-a3a3-40a7-add2-a64125e9b6f3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:08.242791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 835/1703] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:08.244340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076858c-6bf8-4637-965a-a171f229966c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.244450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076858c-6bf8-4637-965a-a171f229966c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.244659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076858c-6bf8-4637-965a-a171f229966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.289258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0076858c-6bf8-4637-965a-a171f229966c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:08.290507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0076858c-6bf8-4637-965a-a171f229966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.333516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:08.353051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:08.409896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c484-6f00-44fe-8dd6-8f6e66e1b928 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:08.416820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.417507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.417843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.418163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.418887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.421027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:08.464161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 869/1704] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:08 2022] POST /identity/v3/users => generated 295 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:08.468552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:08.473813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.479526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 836/1705] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:08.487767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076858c-6bf8-4637-965a-a171f229966c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:08.514700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076858c-6bf8-4637-965a-a171f229966c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:08.539407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.540558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.540882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.541156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.541872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.543490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456cbff-4f7d-443c-9560-63c8158f4c84 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:08.590087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 837/1706] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:08.606362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.606650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.607453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.711732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:08.720919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:08.745990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbedb4-b449-41d2-b67a-ccc7695db821 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:08.752493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.753184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.753486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.753899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.769867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 838/1707] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:08.775011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:08.800875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53766-7d6b-4dc7-a483-ce08dc82206a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:08.825838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:08.826593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:08.826879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:08.827155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] PATH_INFO: `/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed/users/1111c8535a4c43edb2299bb411665e58/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:08.885646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee9f5b0369445ea83f2c31fe9cb84ed, user_id=1111c8535a4c43edb2299bb411665e58, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.888480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:08.945939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 839/1708] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:08 2022] PUT /identity/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed/users/1111c8535a4c43edb2299bb411665e58/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:08.947027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:08.971957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:08.978296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce462a8-eb14-472e-bc8b-b558bbf71659 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:09.013257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 870/1709] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:09.014528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc480-cd92-4413-933b-6b2a087589ec None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.014816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc480-cd92-4413-933b-6b2a087589ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.015683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bc480-cd92-4413-933b-6b2a087589ec None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.037743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 871/1710] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jul 28 06:12:09 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:09.038694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bc480-cd92-4413-933b-6b2a087589ec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:09.154372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922ade-1726-408f-b7a2-8e0075be28d8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:09.160412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:09.161735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.162090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.162470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.168374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:09.168842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:09.172465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e89726-9443-4bb4-a716-d033d3301e24 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:09.204559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 840/1711] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:09.206100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.206317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.206596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.237545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bc480-cd92-4413-933b-6b2a087589ec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:09.251309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:09.252146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.252525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.252924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.253750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:09.255802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21008982-a821-44e8-bc75-5c719c544e2a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:09.257616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:09.258621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:09.260310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:09.295578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 872/1712] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:09.300905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.301302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.301677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.393416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] MFA Rules not processed for user `4f68657a55414ec39a27136701c41936`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:09.403191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:09.419030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 841/1713] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jul 28 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:09.419516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:09.435341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a051b1-ac87-4917-b392-5c44ba0021cb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:09.444143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:09.446537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.446986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.447455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.448734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:09.451575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:09.477983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:09.532180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 842/1714] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:09.533994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:09.651569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 873/1715] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:09.654306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:09.684861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2d68-3a7f-4537-aeb5-d5cf7b210ad6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:09.715808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b90da-a791-472e-8d9f-32b7e182843f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:09.748282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:09.749371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.749930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.750351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] PATH_INFO: `/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed/users/1111c8535a4c43edb2299bb411665e58/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.753941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee9f5b0369445ea83f2c31fe9cb84ed, user_id=1111c8535a4c43edb2299bb411665e58, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:09.757167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:09.804005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 843/1716] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:09 2022] PUT /identity/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed/users/1111c8535a4c43edb2299bb411665e58/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:09.806384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:09.922258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:09.922815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:09.923098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:09.923370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:09.931375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:09.998940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b33c1f-ebf5-4c59-9dd8-2df59d066fb2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:10.000619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:10.002251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f344baf-e3ea-47d8-8cfe-2cfc97c4b850 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:10.025309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:10.025953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.026236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.026512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.027230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:10.029224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b349c3-9119-487c-9744-897ba5c01981 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:10.052796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 874/1717] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:10.054792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.055291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.056009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.123595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 844/1718] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:09 2022] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:10.125460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991104bc-28d5-4940-a799-2026926b0735 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.125747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991104bc-28d5-4940-a799-2026926b0735 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.126021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991104bc-28d5-4940-a799-2026926b0735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.146539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] MFA Rules not processed for user `4f68657a55414ec39a27136701c41936`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:10.151209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:10.303752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-991104bc-28d5-4940-a799-2026926b0735 None None] MFA Rules not processed for user `1111c8535a4c43edb2299bb411665e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:10.322172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-991104bc-28d5-4940-a799-2026926b0735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:10.374717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 875/1719] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:10.376393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:10.377890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:10.400549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12dce-f2bb-4b39-9cbc-058c52ccd8df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:10.407467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:10.408264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.408606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.409331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] PATH_INFO: `/v3/projects/65e192db1854491385622aa1f662ce01` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.418428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e192db1854491385622aa1f662ce01)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:10.421390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:10.444976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:10.536070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e192db1854491385622aa1f662ce01', 'request_id': 'req-34ef57df-76db-448b-ba6f-ebb06c980818'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:10.562973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e192db1854491385622aa1f662ce01', 'request_id': 'req-34ef57df-76db-448b-ba6f-ebb06c980818'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:10.583550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e192db1854491385622aa1f662ce01', 'request_id': 'req-34ef57df-76db-448b-ba6f-ebb06c980818'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:10.603596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 845/1720] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:10.614349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991104bc-28d5-4940-a799-2026926b0735 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:10.616794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] The token cache is being invalidate because project 65e192db1854491385622aa1f662ce01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:10.617190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:10.618613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:10.623182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 876/1721] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:10 2022] DELETE /identity/v3/projects/65e192db1854491385622aa1f662ce01 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:10.623933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:10.628677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:10.629530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:10.645552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991104bc-28d5-4940-a799-2026926b0735 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:10.805580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef57df-76db-448b-ba6f-ebb06c980818 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:10.833188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:10.835526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.835813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.837924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.843524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:10.864885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:10.865865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:10.866403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:10.866845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:10.868298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:10.870520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:10.885356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 846/1722] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:10.886460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:10.889046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.005992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:11.007604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:11.020773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb182-1980-44ee-a4cf-d1ed4ba4de40 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:11.026252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 877/1723] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:11.027210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:11.028704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.029443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:11.035342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.035790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.036360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.045655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.059538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14040ac-2ad8-4917-9a57-382011fab62c service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:11.070169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:11.070955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.071239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.071515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] PATH_INFO: `/v3/users/ba772e8d86d5494eb80cfd8ec2bb09b8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.073374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba772e8d86d5494eb80cfd8ec2bb09b8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:11.076375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:11.164673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:11.186606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba772e8d86d5494eb80cfd8ec2bb09b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:11.188255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba772e8d86d5494eb80cfd8ec2bb09b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:11.221641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba772e8d86d5494eb80cfd8ec2bb09b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:11.243130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba772e8d86d5494eb80cfd8ec2bb09b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:11.243658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba772e8d86d5494eb80cfd8ec2bb09b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:11.286113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 878/1724] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:11 2022] DELETE /identity/v3/users/ba772e8d86d5494eb80cfd8ec2bb09b8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:11.287074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:11.288500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.291302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:11.305617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37899d-3df6-4bec-9f83-55ec657a50d0 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:11.345364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 847/1725] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:11.426150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb32b-2203-4aaf-ba9f-a8b4b9ae8f9f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.426654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb32b-2203-4aaf-ba9f-a8b4b9ae8f9f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.426934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb32b-2203-4aaf-ba9f-a8b4b9ae8f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.502002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-311eb32b-2203-4aaf-ba9f-a8b4b9ae8f9f None None] MFA Rules not processed for user `0a30548bd6834548939706fb60fff231`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:11.503430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-311eb32b-2203-4aaf-ba9f-a8b4b9ae8f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.536306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce7073-22ef-42bb-8a14-818aa5fae508 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:11.554832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:11.565365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.565659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.565937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.566673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:11.568312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:11.610943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 879/1726] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:11.619388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:11.695971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24453900-4739-4c4f-968a-7b2dd31f978e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:11.697636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:11.714129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:11.715038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.720851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.721187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] PATH_INFO: `/v3/projects/5fc756994c5c41b18128451b37349756/users/a9d4660318eb4a33bff43b696779abf3/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.792563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc756994c5c41b18128451b37349756, user_id=a9d4660318eb4a33bff43b696779abf3, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:11.809195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371b3c9-ff11-461e-a675-b910a5756e69 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:11.832988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 848/1727] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:11.880932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 880/1728] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:11 2022] PUT /identity/v3/projects/5fc756994c5c41b18128451b37349756/users/a9d4660318eb4a33bff43b696779abf3/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:11.882438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.882743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.883086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.967443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] MFA Rules not processed for user `a9d4660318eb4a33bff43b696779abf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:11.969153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:11.989521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c421-e187-4b2d-8955-61e2f156a4f8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:11.989521 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c421-e187-4b2d-8955-61e2f156a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:11.989792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c421-e187-4b2d-8955-61e2f156a4f8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:11.993604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 881/1729] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jul 28 06:12:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:12.014095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:12.014283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:12.014558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:12.059332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:12.065339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:12.153429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 849/1730] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:12.165419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:12.166816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:12.303060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 882/1731] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:12.340230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:12.342013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:12.369777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8defa8-91ee-4fd4-9686-a51ab51afcd1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:12.399698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f62bb-8774-4338-bd4b-06def6ef870d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:12.408577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:12.409429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:12.409813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:12.410192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:12.419786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:12.426835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:12.428096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:12.428377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:12.430954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:12.432847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:12.454334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 850/1732] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:12.457742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:12.460060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d42493-b939-4cd6-8259-4b692468a77f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:12.474745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 883/1733] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:12.605725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:12.607339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:12.751172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:12.758383 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382593f-beaf-467d-a8f5-e12f8bfee0a1 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:12.766297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:12.767579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:12.768103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:12.768677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] PATH_INFO: `/v3/projects/e610d6af11ed4752999c8ce555ee4d0e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:12.772789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e610d6af11ed4752999c8ce555ee4d0e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:12.776551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:12.874380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e610d6af11ed4752999c8ce555ee4d0e', 'request_id': 'req-0d66bbda-8ba8-4149-9636-f4601b5c6a41'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:12.882783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e610d6af11ed4752999c8ce555ee4d0e', 'request_id': 'req-0d66bbda-8ba8-4149-9636-f4601b5c6a41'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:12.892362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e610d6af11ed4752999c8ce555ee4d0e', 'request_id': 'req-0d66bbda-8ba8-4149-9636-f4601b5c6a41'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:12.915284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] The token cache is being invalidate because project e610d6af11ed4752999c8ce555ee4d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:12.915586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:12.916349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0d66bbda-8ba8-4149-9636-f4601b5c6a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:12.923450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 851/1734] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:12 2022] DELETE /identity/v3/projects/e610d6af11ed4752999c8ce555ee4d0e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:12.926810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:12.927690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:12.928256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:12.983555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:12.985011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:13.019291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:13.161918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:13.162480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:13.162610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 884/1735] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:13.163040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:13.229780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:13.231048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:13.254439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 852/1736] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:13.259240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:13.276518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8565a25-ebeb-4c19-841e-957bdbcc57e4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:13.317562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:13.319108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:13.319685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:13.325776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:13.326553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:13.328186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:13.332793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:13.376287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 885/1737] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:13.380723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:13.396171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a6b5-6d09-45ab-ad66-806da7008020 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:13.444981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:13.445640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:13.445954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:13.446209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:13.449476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:13.451663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:13.576780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 853/1738] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:13 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:13.578216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:13.591513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e7b3b-1ef6-4962-81f5-7845699077f8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:13.885788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:13.887208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:13.887497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:13.890818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:13.893517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:13.919734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547457e-5337-46f4-a608-7d9cf0b2d70d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:14.043519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 886/1739] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:13 2022] POST /identity/v3/users => generated 292 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:14.047934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.073616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c59f0-b7ba-4b24-ba68-a8f716bfc2ad admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:14.105858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020467ab-7324-4538-81e3-4bc150ec64e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.106276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:14.106606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020467ab-7324-4538-81e3-4bc150ec64e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.106985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020467ab-7324-4538-81e3-4bc150ec64e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.108150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.111475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.113860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.114787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:14.121515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:14.168423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 854/1740] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:14.179219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.211650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c743d2c-50cb-4bdf-963c-a708bed1e46a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:14.235262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:14.236361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.236884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.237264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.238219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:14.240103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06a379-5a58-4e19-8e11-fa2edc9730e5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:14.256514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 855/1741] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:14.257966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.258424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.259111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.286023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-020467ab-7324-4538-81e3-4bc150ec64e3 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:14.287252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-020467ab-7324-4538-81e3-4bc150ec64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:14.295454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] MFA Rules not processed for user `343be19d43aa42a9a0ac7bb88b12e425`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:14.297437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:14.394570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 856/1742] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:14.396718 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.412991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0cf67-aa1e-4f4a-a203-b862e9610fbe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:14.418093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 887/1743] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:12:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:14.422112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:14.422872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.423210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.423546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] PATH_INFO: `/v3/projects/029da21cfd704433b610e463df40b913/users/ecac6481c1f747bcb87ac44998b55ddc/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.455892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029da21cfd704433b610e463df40b913, user_id=ecac6481c1f747bcb87ac44998b55ddc, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:14.462451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:14.513421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 857/1744] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:14 2022] PUT /identity/v3/projects/029da21cfd704433b610e463df40b913/users/ecac6481c1f747bcb87ac44998b55ddc/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:14.517780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.518169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.518485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.543662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:14.558610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] MFA Rules not processed for user `ecac6481c1f747bcb87ac44998b55ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:14.560455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:14.629735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.632011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:14.678968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:14.698805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 888/1745] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:14.703992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.824202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacca16d-05a4-4ac5-945d-7bca23783824 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:14.829722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:14.830657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:14.830657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:14.830988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:14.831666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:14.833655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:14.898632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 889/1746] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:14 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:14.903441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:14.961983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11565617-c55f-4e93-8ebb-af37284031e6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.024763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9610f2-8a45-4bd7-9990-42058835ec2b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.031837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.032487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.032792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.033359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.034776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.037304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.072460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 890/1747] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:14 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:15.073576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:15.090358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b2f0e-324e-4119-b553-4a1369e93dd0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.096607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.098250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.099278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.099872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.100914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.103034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.103273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.104217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.104577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.105026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.119013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 891/1748] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:15.124888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:15.133451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:15.142485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6741bd-3aea-4f3a-b6b5-8538e2838045 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.148975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.150641 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.151386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.152256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] PATH_INFO: `/v3/projects/e2b67c25b80444e597cacd5207795435/users/fe27fe2b352d4621a8eaed53e6ec7e07/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.216671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b67c25b80444e597cacd5207795435, user_id=fe27fe2b352d4621a8eaed53e6ec7e07, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.221441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.237127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.240143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.247841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 892/1749] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:15 2022] PUT /identity/v3/projects/e2b67c25b80444e597cacd5207795435/users/fe27fe2b352d4621a8eaed53e6ec7e07/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:15.248435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:15.252337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:15.281148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 858/1750] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:12:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:12:15.283009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:15.296499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1f67b-9b56-424b-bf82-39bea8a3c800 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.359506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf66ec-bdd8-4bc2-bcb1-8b9710d74a2f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.371932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.373138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.373595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.376020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.380085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:15.469016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:15.528819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.531558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.532408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.535934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.537468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.541142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96d4fb-6e23-4393-aba8-c4f2bd71793a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.578501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 859/1751] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:15.580508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c9b3-f8a0-41fa-8d27-12d5b931f8a0 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.590100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c9b3-f8a0-41fa-8d27-12d5b931f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.590100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c9b3-f8a0-41fa-8d27-12d5b931f8a0 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.590541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.590541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66fa15-6b7a-4cb2-87b3-8c0cf9da5561 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.595953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 860/1752] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:12:15 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:15.598899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c9b3-f8a0-41fa-8d27-12d5b931f8a0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:15.636483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 893/1753] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:15.645314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.646454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.646957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.684302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c9b3-f8a0-41fa-8d27-12d5b931f8a0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:15.706821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:15.711859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.713646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.714340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] PATH_INFO: `/v3/projects/e2b67c25b80444e597cacd5207795435/users/fe27fe2b352d4621a8eaed53e6ec7e07/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.723751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b67c25b80444e597cacd5207795435, user_id=fe27fe2b352d4621a8eaed53e6ec7e07, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:15.729733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b124f-629d-4fa3-acfd-e690bef75dc0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:15.747226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:15.750668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:15.766793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 861/1754] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:15 2022] PUT /identity/v3/projects/e2b67c25b80444e597cacd5207795435/users/fe27fe2b352d4621a8eaed53e6ec7e07/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:15.785656 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:15.787239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:15.787997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:15.965562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] MFA Rules not processed for user `fe27fe2b352d4621a8eaed53e6ec7e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:15.993547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.042841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 894/1755] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:12:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:16.045477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:16.050139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.177673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:16.264054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 862/1756] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:16.315842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:16.317287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.375625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91146d86-ef4c-4168-89bd-db619230eb20 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:16.403447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:16.404301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:16.404583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:16.406611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] PATH_INFO: `/v3/users/a9d4660318eb4a33bff43b696779abf3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:16.415369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d4660318eb4a33bff43b696779abf3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:16.421822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:16.563577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fa2f4-92cd-4c4e-b696-89a0a73f725e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:16.589114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:16.591411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:16.591698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:16.591973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:16.598423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d4660318eb4a33bff43b696779abf3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:16.600742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d4660318eb4a33bff43b696779abf3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:16.626854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:16.628576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:16.665785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 863/1757] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:16.666563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:16.670753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.695742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d4660318eb4a33bff43b696779abf3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:16.730678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d26de-1dd2-4b9e-aa74-f00c6632e151 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:16.736130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d4660318eb4a33bff43b696779abf3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:16.738883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d4660318eb4a33bff43b696779abf3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:16.777400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:16.778265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:16.778548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:16.778820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:16.788667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.804446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 895/1758] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:16 2022] DELETE /identity/v3/users/a9d4660318eb4a33bff43b696779abf3 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:16.808539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:16.814548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:16.841060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:16.857619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20cfba-7507-4c26-86be-2c9331ecb1d0 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:16.891631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 864/1759] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:16.893719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:16.894035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:16.894315 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:16.980490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:16.982170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:17.071261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6edd-af15-4e3d-93ba-79ca3a4bae07 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:17.084145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:17.091668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:17.098590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:17.098590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:17.102282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] PATH_INFO: `/v3/users/ecac6481c1f747bcb87ac44998b55ddc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:17.115021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecac6481c1f747bcb87ac44998b55ddc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:17.123771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:17.196326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 865/1760] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:17.307300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:17.312983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecac6481c1f747bcb87ac44998b55ddc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:17.319007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecac6481c1f747bcb87ac44998b55ddc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:17.347268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:17.369146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:17.383554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecac6481c1f747bcb87ac44998b55ddc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:17.404332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecac6481c1f747bcb87ac44998b55ddc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:17.405224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-db99c3d0-7830-4fe4-9547-1b4e4ff52020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecac6481c1f747bcb87ac44998b55ddc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:17.454096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f19df-d909-4abe-a8fe-83ffc7626017 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:17.464409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:17.465243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:17.465625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:17.466165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:17.468740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:17.477665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 896/1761] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:16 2022] DELETE /identity/v3/users/ecac6481c1f747bcb87ac44998b55ddc => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:17.480087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2fa51-8a1b-4473-aaeb-febd6d179f5b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:17.480378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2fa51-8a1b-4473-aaeb-febd6d179f5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:17.480665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2fa51-8a1b-4473-aaeb-febd6d179f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:17.483064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:17.484976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:17.496745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 866/1762] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:17.549191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-85e2fa51-8a1b-4473-aaeb-febd6d179f5b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:17.551005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-85e2fa51-8a1b-4473-aaeb-febd6d179f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:17.728456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 897/1763] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:17.818058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:17.819927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:17.838488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a2f1-2609-4e56-9d88-f5314de08fcd service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:18.004090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:18.008010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:18.008387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:18.008591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:18.048069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:18.049570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb892db-91d9-4aac-a513-6cbe7cf30032 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:18.117768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 867/1764] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:18.291523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:18.291904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:18.292243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:18.295420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 898/1765] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:18.365488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:18.366145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:18.366145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:18.448027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] MFA Rules not processed for user `3d15a61438b44de4bb2625f3b3b1622f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:18.451461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:18.491332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:18.493477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:18.562031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df80068-dced-475b-a8d0-de9a2c53c1e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:18.594008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:18.594677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:18.594956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:18.595325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] PATH_INFO: `/v3/users/5629e8fccf804d0795a55b0d8b6892c1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:18.602889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5629e8fccf804d0795a55b0d8b6892c1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:18.608260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:18.694016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 868/1766] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:12:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:18.711300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:18.722851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:18.778951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5629e8fccf804d0795a55b0d8b6892c1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:18.779702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5629e8fccf804d0795a55b0d8b6892c1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:18.795486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750194f-3e29-43d7-b26f-c6b2a1094ec7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:18.830853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5629e8fccf804d0795a55b0d8b6892c1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:18.840771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:18.841431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:18.841715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:18.841983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:18.848836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5629e8fccf804d0795a55b0d8b6892c1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:18.849747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5629e8fccf804d0795a55b0d8b6892c1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:18.891181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 899/1767] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:18 2022] DELETE /identity/v3/users/5629e8fccf804d0795a55b0d8b6892c1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:18.891973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:18.896541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:18.944968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 869/1768] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:19.460012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:19.463894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:19.679759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:19.780549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87f8c7-e7ce-4438-9d49-30b225088b63 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:19.791428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:19.792530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:19.793718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:19.794631 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] PATH_INFO: `/v3/users/4f3af7b04a3344b7bbbee8b1d6199de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:19.798087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3af7b04a3344b7bbbee8b1d6199de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:19.803150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:19.927407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3af7b04a3344b7bbbee8b1d6199de4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:19.929040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3af7b04a3344b7bbbee8b1d6199de4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:19.937687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:19.977504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d3e1-5e2c-4e7e-86ee-7d785d9b9aeb service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:19.992148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3af7b04a3344b7bbbee8b1d6199de4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.001707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:20.003220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:20.005064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:20.005630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] PATH_INFO: `/v3/projects/eb16847750be4c3db08bc34a90e68c27` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:20.016723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3af7b04a3344b7bbbee8b1d6199de4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.016723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a8cd2366-8d2a-4603-a05f-f56ee4567825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3af7b04a3344b7bbbee8b1d6199de4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.043175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb16847750be4c3db08bc34a90e68c27)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:20.049323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:20.053798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:20.079179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 900/1769] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:19 2022] DELETE /identity/v3/users/4f3af7b04a3344b7bbbee8b1d6199de4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:20.089482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:20.092960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:20.094687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:20.166456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:20.168500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:20.228548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb16847750be4c3db08bc34a90e68c27', 'request_id': 'req-6ee88ccf-8c45-4297-bbc2-6898c0070028'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.265280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb16847750be4c3db08bc34a90e68c27', 'request_id': 'req-6ee88ccf-8c45-4297-bbc2-6898c0070028'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.284007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb16847750be4c3db08bc34a90e68c27', 'request_id': 'req-6ee88ccf-8c45-4297-bbc2-6898c0070028'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.319432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] The token cache is being invalidate because project eb16847750be4c3db08bc34a90e68c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:20.319917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.322680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.326577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 870/1770] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:19 2022] DELETE /identity/v3/projects/eb16847750be4c3db08bc34a90e68c27 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:20.331473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:20.333553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:20.427355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 901/1771] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:20.468244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:20.469662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:20.483805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88ccf-8c45-4297-bbc2-6898c0070028 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:20.497412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:20.498151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:20.498436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:20.498739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] PATH_INFO: `/v3/users/0a30548bd6834548939706fb60fff231` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:20.501441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a30548bd6834548939706fb60fff231)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:20.503762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:20.610743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171832e-fa9e-4c93-bece-52688f00c714 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:20.615485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:20.617001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:20.617244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:20.618352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:20.637734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:20.640158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6f07c-ec0d-44ed-abdc-a465ca83a587 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:20.656603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:20.677868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 902/1772] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:20.682211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a30548bd6834548939706fb60fff231'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.693908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a30548bd6834548939706fb60fff231'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.694835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a30548bd6834548939706fb60fff231'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.705320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a30548bd6834548939706fb60fff231'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.747076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a30548bd6834548939706fb60fff231'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:20.765118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 871/1773] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:20 2022] DELETE /identity/v3/users/0a30548bd6834548939706fb60fff231 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:21.576446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:21.576974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:21.576974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:21.649077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:21.655420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:21.917370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 903/1774] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 28 06:12:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:21.929829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:21.931323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:21.950215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:22.152463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe5ad6-d167-4dd1-a4d7-87ad92f5231c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:22.165538 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:22.167541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:22.167839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:22.168117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] PATH_INFO: `/v3/projects/8ba9d0f25d164349bb01da3dce4b940b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:22.171461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba9d0f25d164349bb01da3dce4b940b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:22.177128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:22.180546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:22.186325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:22.213958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef003cec-a579-433c-9653-9d133dd5a2e6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:22.224362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:22.225068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:22.225351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:22.225624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] PATH_INFO: `/v3/projects/029da21cfd704433b610e463df40b913` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:22.233696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029da21cfd704433b610e463df40b913)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:22.235630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:22.388516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029da21cfd704433b610e463df40b913', 'request_id': 'req-80b0d447-c8af-4051-9e9a-5154edba59f9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.420996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029da21cfd704433b610e463df40b913', 'request_id': 'req-80b0d447-c8af-4051-9e9a-5154edba59f9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.441811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba9d0f25d164349bb01da3dce4b940b', 'request_id': 'req-abcfe97e-c0ee-4d3b-864c-fb5732536af9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.449480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029da21cfd704433b610e463df40b913', 'request_id': 'req-80b0d447-c8af-4051-9e9a-5154edba59f9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.485391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] The token cache is being invalidate because project 029da21cfd704433b610e463df40b913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:22.485685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.486721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.490472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 904/1775] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:22 2022] DELETE /identity/v3/projects/029da21cfd704433b610e463df40b913 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:22.499677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba9d0f25d164349bb01da3dce4b940b', 'request_id': 'req-abcfe97e-c0ee-4d3b-864c-fb5732536af9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.500855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:22.505045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:22.548258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba9d0f25d164349bb01da3dce4b940b', 'request_id': 'req-abcfe97e-c0ee-4d3b-864c-fb5732536af9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.602592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] The token cache is being invalidate because project 8ba9d0f25d164349bb01da3dce4b940b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:22.602892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.608511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.630876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 872/1776] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:21 2022] DELETE /identity/v3/projects/8ba9d0f25d164349bb01da3dce4b940b => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:22.630876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:22.633513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:22.712020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0d447-c8af-4051-9e9a-5154edba59f9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:22.746798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:22.747600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:22.747889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:22.748350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] PATH_INFO: `/v3/projects/c3f1746adec44a889c67fff787d11b70` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:22.758759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f1746adec44a889c67fff787d11b70)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:22.760177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:22.858936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:22.868209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfe97e-c0ee-4d3b-864c-fb5732536af9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:22.913917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f1746adec44a889c67fff787d11b70', 'request_id': 'req-104f6504-24aa-48bf-8d85-c08de92b214e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.939348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f1746adec44a889c67fff787d11b70', 'request_id': 'req-104f6504-24aa-48bf-8d85-c08de92b214e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.954563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f1746adec44a889c67fff787d11b70', 'request_id': 'req-104f6504-24aa-48bf-8d85-c08de92b214e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:22.984485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:22.986087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:22.986517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:22.987126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:22.991154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.000732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] The token cache is being invalidate because project c3f1746adec44a889c67fff787d11b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:23.002050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.003003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.019428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:23.019428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:23.020172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 905/1777] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:22 2022] DELETE /identity/v3/projects/c3f1746adec44a889c67fff787d11b70 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:23.023255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:23.024926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:23.030115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.035661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 873/1778] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:23.037809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:23.039448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.053672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6504-24aa-48bf-8d85-c08de92b214e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:23.102270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:23.103746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:23.104084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:23.104332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:23.127889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.166800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:23.181310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:23.222995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 906/1779] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:23.227061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:23.234202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.334907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669e77-2444-4101-ba5f-1e27da987ac1 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:23.353702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:23.354428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:23.356921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:23.357223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] PATH_INFO: `/v3/users/fe27fe2b352d4621a8eaed53e6ec7e07` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:23.360330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe27fe2b352d4621a8eaed53e6ec7e07)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:23.366516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:23.558451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe27fe2b352d4621a8eaed53e6ec7e07'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.610332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe27fe2b352d4621a8eaed53e6ec7e07'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.611423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe27fe2b352d4621a8eaed53e6ec7e07'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.625873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3f73b-e2c4-4062-9987-452abe3ab9d9 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:23.633902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe27fe2b352d4621a8eaed53e6ec7e07'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.646506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:23.647158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:23.647443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:23.647720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] PATH_INFO: `/v3/users/d4bc36c5f1fd4163adccde78d1295381` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:23.651702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bc36c5f1fd4163adccde78d1295381)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:23.657190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:23.694229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe27fe2b352d4621a8eaed53e6ec7e07'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.712634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 874/1780] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:23 2022] DELETE /identity/v3/users/fe27fe2b352d4621a8eaed53e6ec7e07 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:23.713616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:23.718808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:23.821878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bc36c5f1fd4163adccde78d1295381'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.823694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bc36c5f1fd4163adccde78d1295381'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.902810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bc36c5f1fd4163adccde78d1295381'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.924906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71b5e-eaf7-4ad6-8319-26ede3139723 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:23.927845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bc36c5f1fd4163adccde78d1295381'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.928736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1d8d9066-004b-41b5-85b1-329a04f013f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bc36c5f1fd4163adccde78d1295381'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:23.946385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:23.947147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:23.947474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:23.947783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] PATH_INFO: `/v3/projects/5fc756994c5c41b18128451b37349756` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:23.950120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc756994c5c41b18128451b37349756)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:23.955401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:23.974209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 907/1781] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:23 2022] DELETE /identity/v3/users/d4bc36c5f1fd4163adccde78d1295381 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:23.986827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6f58-f074-4eaf-96cd-7a4c0856e7ea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:23.994410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6f58-f074-4eaf-96cd-7a4c0856e7ea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:23.994763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6f58-f074-4eaf-96cd-7a4c0856e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.021449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:24.084881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-320a6f58-f074-4eaf-96cd-7a4c0856e7ea None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:24.084881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-320a6f58-f074-4eaf-96cd-7a4c0856e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:24.103576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc756994c5c41b18128451b37349756', 'request_id': 'req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:24.122699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc756994c5c41b18128451b37349756', 'request_id': 'req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:24.130577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc756994c5c41b18128451b37349756', 'request_id': 'req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:24.145797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:24.152023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] The token cache is being invalidate because project 5fc756994c5c41b18128451b37349756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:24.152469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:24.155273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e7e5bc4c-6617-4d89-9a58-e07b95aa4c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:24.160671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 875/1782] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:23 2022] DELETE /identity/v3/projects/5fc756994c5c41b18128451b37349756 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:24.165360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187604-bf03-4f2a-b998-b760518b371c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.165968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187604-bf03-4f2a-b998-b760518b371c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.166612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3187604-bf03-4f2a-b998-b760518b371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.198689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b3187604-bf03-4f2a-b998-b760518b371c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:24.200164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b3187604-bf03-4f2a-b998-b760518b371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:24.274228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 908/1783] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:24.282809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.283088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.283363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.322863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:24.324256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:24.351764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 876/1784] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:24.355563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 909/1785] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:24.359994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.360487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.360992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.361376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.397503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:24.399119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:24.428014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896b440-37d4-4884-8b48-c53fe5bf67b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.428470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 877/1786] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:24.433579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.449938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.450657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.451814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.452679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.453860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:24.455080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.460303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bd6a8-c4d2-43c5-8b1c-f6ba80dbcab1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.461571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.476607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.477455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.477740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.478016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.481844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:24.482212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.484409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.506065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 910/1787] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:24.512182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.530597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fc14-c4f1-495c-a5e0-a3a4c0584f41 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.540960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.540960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.540960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.540960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.541416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 878/1788] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:24.541512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.542936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.547329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.573652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18d36f-5538-454e-9e49-2139ba5b4f7e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.584399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.585554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.586444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.586783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.589923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.593676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.639469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 911/1789] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:24.643803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.644556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 879/1790] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:24.649366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.818590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdde34-524b-4fc4-9cff-c16759184077 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.819500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db767b-f8d2-454a-91d1-71efdb8e9e72 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.834658 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.836258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.838779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.841308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.842417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.843350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.844069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.844557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.845445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.846507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.854979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.856469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.881852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:24.911716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 880/1791] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:24.914691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 912/1792] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:24 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:24.915138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.919744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.936000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6480-e910-4ba2-8853-ef14b32df7b1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.943424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.944248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.945283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bddc48-8928-4f40-889d-df563ee4a7c3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.945491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.945963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.947262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.949602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.965315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.966163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.966604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.967070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.968865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.970785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 881/1793] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:24.970985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:24.971714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:24.988955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fe506-cf48-47fb-ae5b-4c80a0c9f978 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:24.994542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:24.994936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:24.995258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:24.995586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:24.996489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:24.999426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.000159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 913/1794] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:25.001357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.016707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 882/1795] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:25.025429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.026248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d904a-17db-409f-ba2f-02d8212ff916 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.038778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.040530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.042279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.042747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.045558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.047952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.053769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3ca2-4151-47a8-a9f9-bf5c90970660 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.061402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.062165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.062453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.062726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] PATH_INFO: `/v3/projects/5f231bad842144eaa300cc6ba45e7e34/users/302f8d57c3b4487c9569f1da421345bd/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.087983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f231bad842144eaa300cc6ba45e7e34, user_id=302f8d57c3b4487c9569f1da421345bd, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.088828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 914/1796] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:25.090164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.091397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3704-3733-4fab-af3c-7b07d5541c5d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.116925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 883/1797] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:25 2022] PUT /identity/v3/projects/5f231bad842144eaa300cc6ba45e7e34/users/302f8d57c3b4487c9569f1da421345bd/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:25.121399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc402f-9e14-4c5e-8f1d-f0f8eef6e8e6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.126397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447466b-b516-41ef-a279-af96265262a3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.126767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447466b-b516-41ef-a279-af96265262a3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.127672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447466b-b516-41ef-a279-af96265262a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.170136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7447466b-b516-41ef-a279-af96265262a3 None None] MFA Rules not processed for user `302f8d57c3b4487c9569f1da421345bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:25.172071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7447466b-b516-41ef-a279-af96265262a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:25.190341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:25.209612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.210278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.210632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.210962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] PATH_INFO: `/v3/projects/547c4007deea475b973c1fc5215fb9b1/users/7b454cbf0bc145a4a877f91ce287d8bf/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.245304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=547c4007deea475b973c1fc5215fb9b1, user_id=7b454cbf0bc145a4a877f91ce287d8bf, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.248574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841425b-03cc-466a-9eb5-0d91d05c91fc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.290009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 884/1798] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:25.294659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447466b-b516-41ef-a279-af96265262a3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.310391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 915/1799] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:25 2022] PUT /identity/v3/projects/547c4007deea475b973c1fc5215fb9b1/users/7b454cbf0bc145a4a877f91ce287d8bf/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:25.317846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.318248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.322261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.361094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447466b-b516-41ef-a279-af96265262a3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.412939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] MFA Rules not processed for user `7b454cbf0bc145a4a877f91ce287d8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:25.414280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:25.550084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.550654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.552058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.552343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.553070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.562953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.606433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 916/1800] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:25.615996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.623478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 885/1801] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/projects => generated 409 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:25.628326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.673287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f257e-552d-4931-850b-151f36c5d0f7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.685531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:25.845551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5a05-fbcb-4968-91e6-c52cf3fc0ce3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:25.847343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.848036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.848332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.848597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.849289 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.851260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.866543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:25.870514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:25.871432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:25.873053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:25.876866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:25.888436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:25.929969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 917/1802] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/projects => generated 379 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:25.930917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:25.932809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:25.990009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 886/1803] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/users => generated 311 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:25.993829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.019310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:26.041991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141c666-70d4-48dc-8905-8a364857ad0b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.063534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.063752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.064958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.065248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.068805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.070462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c744e5-dceb-48d2-823d-619628cea55c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.073457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.080919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.081904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.082574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.083184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] PATH_INFO: `/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.089632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c19da6d0ec4bd2baafe078abef1ca8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.093305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.154935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 887/1804] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:25 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:26.158762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.175509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c19da6d0ec4bd2baafe078abef1ca8', 'request_id': 'req-895a53f0-4cfc-404f-9fe2-60ad6af0828f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:26.183997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c19da6d0ec4bd2baafe078abef1ca8', 'request_id': 'req-895a53f0-4cfc-404f-9fe2-60ad6af0828f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:26.202110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c19da6d0ec4bd2baafe078abef1ca8', 'request_id': 'req-895a53f0-4cfc-404f-9fe2-60ad6af0828f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:26.216700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222593-2fe2-4af7-bbde-8146034742b5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.239211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] The token cache is being invalidate because project 12c19da6d0ec4bd2baafe078abef1ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:26.239543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:26.244879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:26.250222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 918/1805] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:25 2022] DELETE /identity/v3/projects/12c19da6d0ec4bd2baafe078abef1ca8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:26.251388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.254760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:26.412863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.415197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.415197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.417113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.418920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.426100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fb205-6ff8-446d-af80-cfa55b13a2ee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.433306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a53f0-4cfc-404f-9fe2-60ad6af0828f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.446515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.448161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.448454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.448759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.450694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 888/1806] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:26.452575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.455941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.456233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.458391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.461200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.478985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 919/1807] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:26.483409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.485306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:26.507370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd1321-8ddd-4040-9b0e-62ce3791a457 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.522583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.523294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.523574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.523848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] PATH_INFO: `/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8/users/c38b988021444370a0b6a3841783f4f7/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.542530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:26.543916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:26.562392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc49cdbac0b54818bb8c7e5c33f052e8, user_id=c38b988021444370a0b6a3841783f4f7, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.574965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4f39-967c-4334-8402-e2e18ad0c53c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.581597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 889/1808] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:26.583751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.605178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 920/1809] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:26 2022] PUT /identity/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8/users/c38b988021444370a0b6a3841783f4f7/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:26.609389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.609683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.609953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.622844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44135d-673f-41b6-bc51-9cf4bc5d3b51 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.644138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:26.646528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:26.793687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:26.873098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 921/1810] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:26.875871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.905602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.907908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.908356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.908818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] PATH_INFO: `/v3/projects/d5c1e7571b8246dda797f34854659bd2/users/2efececae27941e4a0e73a0e9d4e96e9/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.923204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650cf0a-5676-48b9-835e-f14161c641d1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:26.944338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c1e7571b8246dda797f34854659bd2, user_id=2efececae27941e4a0e73a0e9d4e96e9, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.945391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:26.946140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:26.946544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:26.946919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:26.947726 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:26.948426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.950207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:26.984602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 890/1811] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:26 2022] PUT /identity/v3/projects/d5c1e7571b8246dda797f34854659bd2/users/2efececae27941e4a0e73a0e9d4e96e9/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:26.986852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:26.994321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 922/1812] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:26.997553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:27.015522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:27.022313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a86be9-cc2d-4405-861d-88ce17f5372d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.163806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.164550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.164845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.165159 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.165858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.167902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.214538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 923/1813] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:27.232014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:27.281566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4f0b-a397-48ac-a126-40871927fbc2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.283529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e205c-9e7f-48ff-b6d8-38295bd6bcf0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.289192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.290184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.291252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.292142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] PATH_INFO: `/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8/users/c38b988021444370a0b6a3841783f4f7/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.295352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc49cdbac0b54818bb8c7e5c33f052e8, user_id=c38b988021444370a0b6a3841783f4f7, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.296587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.297725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.298183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.298590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.299677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:27.300600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.300878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.303687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.322283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 924/1814] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:27 2022] PUT /identity/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8/users/c38b988021444370a0b6a3841783f4f7/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:27.324163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:27.326881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:27.330452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 891/1815] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:27.331425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:27.348849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe8245-cae7-472e-9083-c2ef356d26c4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.439659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db864346-028f-4c04-a7e0-a686f46fc02d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.454005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.454865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.455245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.455620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] PATH_INFO: `/v3/projects/e2b67c25b80444e597cacd5207795435` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.457337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b67c25b80444e597cacd5207795435)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.459549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.480349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.481457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.482470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.482763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] PATH_INFO: `/v3/projects/d5c1e7571b8246dda797f34854659bd2/users/2efececae27941e4a0e73a0e9d4e96e9/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.486132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c1e7571b8246dda797f34854659bd2, user_id=2efececae27941e4a0e73a0e9d4e96e9, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.489876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b441dbf-38a1-4dae-bab1-3bc58b378343 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.511094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 892/1816] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:27 2022] PUT /identity/v3/projects/d5c1e7571b8246dda797f34854659bd2/users/2efececae27941e4a0e73a0e9d4e96e9/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:27.512674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589e4e-892a-4488-b7a1-d205dd54ca13 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.513004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589e4e-892a-4488-b7a1-d205dd54ca13 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.513323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea589e4e-892a-4488-b7a1-d205dd54ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.583970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b67c25b80444e597cacd5207795435', 'request_id': 'req-a11afa6e-96c3-44b1-869b-0b194c944151'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:27.590601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ea589e4e-892a-4488-b7a1-d205dd54ca13 None None] MFA Rules not processed for user `c38b988021444370a0b6a3841783f4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:27.594375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ea589e4e-892a-4488-b7a1-d205dd54ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:27.603247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b67c25b80444e597cacd5207795435', 'request_id': 'req-a11afa6e-96c3-44b1-869b-0b194c944151'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:27.621551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b67c25b80444e597cacd5207795435', 'request_id': 'req-a11afa6e-96c3-44b1-869b-0b194c944151'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:27.634871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:27.674618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] The token cache is being invalidate because project e2b67c25b80444e597cacd5207795435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:27.675820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:27.677052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:27.683616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 925/1817] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:27 2022] DELETE /identity/v3/projects/e2b67c25b80444e597cacd5207795435 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:27.685591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:27.693103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:27.785586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 893/1818] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:27.788546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.791072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.791362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.867236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] MFA Rules not processed for user `2efececae27941e4a0e73a0e9d4e96e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:27.868567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:27.869048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afa6e-96c3-44b1-869b-0b194c944151 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:27.885021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:27.885894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.886005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.886216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:27.886892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:27.888869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fcac6-ac21-44dd-81bd-14235c66b1e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:27.889046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:27.985311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 926/1819] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:27 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:27.988572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:27.989602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:27.990182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.038016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:28.039245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:28.057767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 894/1820] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:28.058503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:28.062239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:28.213162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 927/1821] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:28.214734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:28.226902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511603b-9366-4541-ab82-c6bf352d78e3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:28.254130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e27b-d4a6-460a-90df-0acec36e9aa3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:28.274429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:28.275748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.276392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.277683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.278646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:28.283457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcdfe-d2a5-4c90-b116-6eb4162ede1d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:28.333280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 928/1822] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:28 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:28.334954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bedb8-5c7b-4541-b709-a9d93068b0d8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.335398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bedb8-5c7b-4541-b709-a9d93068b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.335865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bedb8-5c7b-4541-b709-a9d93068b0d8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.338570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 929/1823] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:28.340154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.340897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.341337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.355207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:28.355901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.356267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.356591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.417460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:28.421436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:28.440819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 930/1824] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:28.444200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:28.449529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:28.476758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d532-2a84-4435-8de8-8b1db10848dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:28.487503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:28.488294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.488543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.489516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.526256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:28.527753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65635575-7d1b-4f43-9fde-f640ba75337b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:28.575621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 895/1825] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:28.581848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c89fe-44a2-478e-a312-eb36edc6964a None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.584537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c89fe-44a2-478e-a312-eb36edc6964a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.585089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c89fe-44a2-478e-a312-eb36edc6964a None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.595095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 896/1826] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:12:28 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:28.596297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c89fe-44a2-478e-a312-eb36edc6964a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:28.634077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c89fe-44a2-478e-a312-eb36edc6964a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:28.645666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:28.647108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.647631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.648169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.649769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:28.652568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d60af2-975a-4a59-af62-f4dc2515bacb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:28.668093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:28.689361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 897/1827] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:28.709929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.709929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.709929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.713342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:28.714871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:28.731429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:28.753583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 931/1828] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:28.754457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:28.776477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422685e-6103-409f-94e9-4c975b66737f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:28.787441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:28.788569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.788721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:28.789236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.789866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.789980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:28.791711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:28.791711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:28.793989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c86ad-9223-44a7-b623-a9bf94e08184 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:28.835539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 932/1829] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:28.837800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:28.844766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:28.844766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:28.880586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:28.883115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.014921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 898/1830] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:29.016206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.030749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab94521-8d29-442b-a427-cb291bee151d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.036733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.036733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.037006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.037711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.038115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.039752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.051650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 899/1831] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:29.052706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.068550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 933/1832] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:29.069508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.074828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d1900-c582-4ddc-b102-5c0accca72e3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.085801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.086505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.086717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.086993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.087931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.089903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.095666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20d7df-cdd1-465d-bf5e-4569e1fa0f83 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.104008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.104871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.105124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.105266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] PATH_INFO: `/v3/projects/1ed90ffb84a34648b3bd6b04375f3202/users/d4489e58d5e040fa87319beb32324224/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.133066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed90ffb84a34648b3bd6b04375f3202, user_id=d4489e58d5e040fa87319beb32324224, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.136132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.152111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 900/1833] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:29.153310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.162543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 934/1834] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:29 2022] PUT /identity/v3/projects/1ed90ffb84a34648b3bd6b04375f3202/users/d4489e58d5e040fa87319beb32324224/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:29.164250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.249277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cbd2-744e-4fdd-b2ee-09b724a95948 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.258456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.259103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.261559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.261866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.268168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.284122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c8b3d-175a-4891-8a77-d37875b2ae1a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.288748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.289569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.289931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.290211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.292017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.343742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.345363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.355333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 901/1835] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:29.356145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.371037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.372533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74dbd5-cf8e-4c33-848f-991a2b67702d service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.378730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:29.380582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:29.393536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 935/1836] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:29.395435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.395583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.395787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.433437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] MFA Rules not processed for user `d4489e58d5e040fa87319beb32324224`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:29.434661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.465575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25478e7-7370-40dd-a4bc-b41076f6480a service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.479248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.479974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.480318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.480675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.483241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.485436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.528717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 902/1837] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:29.533388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.536026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.550361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 936/1838] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:29.551426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.557578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:29.644942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9dfac-c956-4ef5-8072-dfbab980b3e1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.657587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.658236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.658520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.658792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.671402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.674502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.677601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886873f-49d1-4889-bea1-cd20b053cb9e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.684381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.685004 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.685281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.685549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.687287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 903/1839] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:29.689762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.696029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.697358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.705366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84932d12-7b5c-4c93-84b1-0c42f5b799a7 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.714274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 937/1840] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:29.714448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.715243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.715349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.715611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.716006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.717523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.720159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.728194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdfc4d-ff77-4740-853f-971df1e085ae service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.734801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.738224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 904/1841] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:29.738360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.738360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.738360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.738360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.739038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.740126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.759624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaed822-d233-4f85-87e2-68dab9f3a7ca admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.768780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.769372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.769650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.769925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.771452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.779589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.787758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 938/1842] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:29.790653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.794992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 905/1843] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:29.798839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.818610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d36f81-7c5e-4080-83e8-07877b45f81a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.888623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:29.895436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.896205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.896412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.897452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] PATH_INFO: `/v3/projects/0d6a7e2fc1204042ae67d607c095a33c/users/d67b768aa5574b918cd3d9ab8692a044/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.903892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41508efd-220c-47d5-9bd2-aa114a62109f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:29.913104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:29.914067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:29.915167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.916182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.916490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.917897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.918127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a7e2fc1204042ae67d607c095a33c, user_id=d67b768aa5574b918cd3d9ab8692a044, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:29.920316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50000f-d072-463a-a8a9-c2fba4ed42c1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.921959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:29.944113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 906/1844] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:29 2022] PUT /identity/v3/projects/0d6a7e2fc1204042ae67d607c095a33c/users/d67b768aa5574b918cd3d9ab8692a044/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:29.951440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 939/1845] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:29.953424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:29.955705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970582-4fad-40d2-908a-706311375471 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:29.956255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970582-4fad-40d2-908a-706311375471 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:29.956785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970582-4fad-40d2-908a-706311375471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:29.989160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-85970582-4fad-40d2-908a-706311375471 None None] MFA Rules not processed for user `d67b768aa5574b918cd3d9ab8692a044`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:29.990440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-85970582-4fad-40d2-908a-706311375471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:30.022785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85828c-a24e-4509-8cd3-3d8d50319614 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.027690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.028308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.028590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.029079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.030004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.031607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.045169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 907/1846] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:30.046470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.056089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02604108-80ed-462c-b885-30ae53c3ca05 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.059456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 940/1847] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:30.061844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.062507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.062783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.063052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] PATH_INFO: `/v3/projects/168bc69be48f455f94a8914b1d3b9e44/users/38e3b47903504a9b94fa7a57697030fb/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.064663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85970582-4fad-40d2-908a-706311375471 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.075594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85970582-4fad-40d2-908a-706311375471 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.078811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168bc69be48f455f94a8914b1d3b9e44, user_id=38e3b47903504a9b94fa7a57697030fb, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.081542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.086116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.086741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.087028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.087539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.088399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.090126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.104227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 908/1848] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:30 2022] PUT /identity/v3/projects/168bc69be48f455f94a8914b1d3b9e44/users/38e3b47903504a9b94fa7a57697030fb/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:30.108186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.119096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 941/1849] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:30 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:30.122922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.180300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870888f4-e297-40fa-868b-afd2e6324962 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.203493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083a06-e52a-4e51-a50a-a01b46c1258f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.206978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.208018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.208362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.208759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.209500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.212008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.241065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 942/1850] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:30 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:30.251771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.252402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.252715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.252999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.253694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.253944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.255796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.273511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 909/1851] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:30.274871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d789-f1e3-468b-96b3-1ec6ccddcb62 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.277747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.280161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.280894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.281238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.281590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.283105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.284990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.291368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f350-abfc-4b49-84e2-894388b861a7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.298765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.299820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.300155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.300421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] PATH_INFO: `/v3/projects/168bc69be48f455f94a8914b1d3b9e44/users/38e3b47903504a9b94fa7a57697030fb/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.302721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=168bc69be48f455f94a8914b1d3b9e44, user_id=38e3b47903504a9b94fa7a57697030fb, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.304815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 943/1852] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:30.305937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbca7-ab2d-4a7c-8c37-3bdbb81475ac admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.307405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.309125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:30.318914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bac8b-4215-4cb6-af58-5d253387dae5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.335077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 910/1853] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:30 2022] PUT /identity/v3/projects/168bc69be48f455f94a8914b1d3b9e44/users/38e3b47903504a9b94fa7a57697030fb/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:30.338204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.338533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.338885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.364826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:30.383126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] MFA Rules not processed for user `38e3b47903504a9b94fa7a57697030fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:30.386071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:30.424968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.426350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.426350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.426350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] PATH_INFO: `/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8/users/4f7d48bafc0d43ec8c923a1189551b7e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.443257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7081fdeabbb49a3a1f10cdf7dc020a8, user_id=4f7d48bafc0d43ec8c923a1189551b7e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.449079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.476366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 944/1854] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:30 2022] PUT /identity/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8/users/4f7d48bafc0d43ec8c923a1189551b7e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:30.477839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.516938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 911/1855] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:30.528559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.592085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027168-98ef-4321-bf3b-4cf65d73f535 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.596174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.596830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.597184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.597522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.598283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.600220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.614246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41856c5-d2da-4510-ae2c-634721e3a0e7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.619357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 945/1856] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:30.624061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.636404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c936c5-2097-45c4-bb8b-6aa1562b8901 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.642368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.643500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.644112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.644580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] PATH_INFO: `/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8/users/4f7d48bafc0d43ec8c923a1189551b7e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.647059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7081fdeabbb49a3a1f10cdf7dc020a8, user_id=4f7d48bafc0d43ec8c923a1189551b7e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.651115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da330bf-96dd-4ebc-a4cf-fbca8f956139 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.668057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 946/1857] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:30 2022] PUT /identity/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8/users/4f7d48bafc0d43ec8c923a1189551b7e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:30.683891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.684389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.685036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.700446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.701245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.701717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.702425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:30.741970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] MFA Rules not processed for user `4f7d48bafc0d43ec8c923a1189551b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:30.757768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:30.773618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:30.798901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:30.801667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:30.815197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 912/1858] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:30.850666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 947/1859] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:30.861344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:30.873536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa161e7a-471c-4b05-9663-144cfd47c52f service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:30.986932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:30.987597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:30.989020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:30.990533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:31.001466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:31.003714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:31.016684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 913/1860] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:31.463213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:31.492831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fd60b-5c08-4155-adef-5bfb14942782 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:31.502545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:31.503338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:31.503945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:31.504300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:31.529983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:31.578639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:31.580176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:31.592619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 948/1861] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:31.695028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:31.710777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e01fd-3c67-4f97-bcf7-5d6789c2cd55 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:31.717117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f7d48bafc0d43ec8c923a1189551b7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:31.717792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:31.718074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:31.718356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:31.719059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:31.719366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:31.721038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:31.737260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 914/1862] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:31.741489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:31.755900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc1f1-8909-4b59-95e3-90483d921850 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:31.762405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f7d48bafc0d43ec8c923a1189551b7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:31.763174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:31.763828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:31.764001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:31.765023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:31.767497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:31.800686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 949/1863] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:31 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:31.803862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:31.816953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa415d2-7688-4fd2-b6fc-dbce5b226e4a tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:31.913273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f7d48bafc0d43ec8c923a1189551b7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:31.914834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:31.918499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:31.918900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:31.919702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:31.920232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:31.927041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:31.969685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 915/1864] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:32.016899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:32.028464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd832-01a6-4221-b8bc-cbbb47c5facb tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:32.034103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f7d48bafc0d43ec8c923a1189551b7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:32.034828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:32.035181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:32.035519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] PATH_INFO: `/v3/projects/1797990985f54f029f4f122cb4d373aa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:32.036801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1797990985f54f029f4f122cb4d373aa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:32.038772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:32.101276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1797990985f54f029f4f122cb4d373aa', 'request_id': 'req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.108850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1797990985f54f029f4f122cb4d373aa', 'request_id': 'req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.115725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1797990985f54f029f4f122cb4d373aa', 'request_id': 'req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.130736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] The token cache is being invalidate because project 1797990985f54f029f4f122cb4d373aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:32.131100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.131888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-42a3ddbd-fe90-4e93-bf95-d8758a3de2b0 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.133692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 950/1865] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:32 2022] DELETE /identity/v3/projects/1797990985f54f029f4f122cb4d373aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:32.329266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:32.331076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:32.397219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2998-d9b5-4320-8552-75dc4d07bc06 tempest-VolumeQuotaClassesTest-1013920233 tempest-VolumeQuotaClassesTest-1013920233-project-admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:32.410388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:32.457021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:32.457677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:32.457954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:32.458226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] PATH_INFO: `/v3/users/d67b768aa5574b918cd3d9ab8692a044` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:32.459377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67b768aa5574b918cd3d9ab8692a044)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:32.461323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:32.508515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67b768aa5574b918cd3d9ab8692a044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.516248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67b768aa5574b918cd3d9ab8692a044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.516956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67b768aa5574b918cd3d9ab8692a044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.524405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67b768aa5574b918cd3d9ab8692a044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.538162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67b768aa5574b918cd3d9ab8692a044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:32.544578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 916/1866] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:32 2022] DELETE /identity/v3/users/d67b768aa5574b918cd3d9ab8692a044 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:32.549340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:32.549827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:32.550111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:32.569674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:32.571076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:32.636216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 951/1867] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:32.646609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:32.648200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:32.716118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810511-e66a-4bb6-bc04-d98efaee0f0b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:32.720629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:32.721291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:32.721575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:32.721851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:32.731843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:32.733679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:32.755929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 917/1868] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:33.166654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:33.169144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:33.187317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f03e0-f7b7-4e14-b01c-92ac6b74699a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:33.201466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:33.216997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:33.218934 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:33.221274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] PATH_INFO: `/v3/projects/0d6a7e2fc1204042ae67d607c095a33c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:33.224389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6a7e2fc1204042ae67d607c095a33c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:33.234427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:33.283299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:33.345594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6a7e2fc1204042ae67d607c095a33c', 'request_id': 'req-c6f83d50-d70c-4587-9bbb-26fe476e0b68'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.355910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6a7e2fc1204042ae67d607c095a33c', 'request_id': 'req-c6f83d50-d70c-4587-9bbb-26fe476e0b68'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.364162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6a7e2fc1204042ae67d607c095a33c', 'request_id': 'req-c6f83d50-d70c-4587-9bbb-26fe476e0b68'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.384239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] The token cache is being invalidate because project 0d6a7e2fc1204042ae67d607c095a33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:33.384613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.385613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.392169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 952/1869] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:33 2022] DELETE /identity/v3/projects/0d6a7e2fc1204042ae67d607c095a33c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:33.393574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:33.405458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06a6f2-a34b-49cc-9793-56b2d5027b8f service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:33.449421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:33.478361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:33.479017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:33.479298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:33.479574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] PATH_INFO: `/v3/users/4f7d48bafc0d43ec8c923a1189551b7e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:33.480769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7d48bafc0d43ec8c923a1189551b7e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:33.482675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:33.529269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7d48bafc0d43ec8c923a1189551b7e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.537306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7d48bafc0d43ec8c923a1189551b7e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.538008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7d48bafc0d43ec8c923a1189551b7e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.545132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7d48bafc0d43ec8c923a1189551b7e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.557638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7d48bafc0d43ec8c923a1189551b7e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:33.563714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 918/1870] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:33 2022] DELETE /identity/v3/users/4f7d48bafc0d43ec8c923a1189551b7e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:33.865262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:33.866821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:33.881773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83d50-d70c-4587-9bbb-26fe476e0b68 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:33.960379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:33.961942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:33.962101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:33.962883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:33.963155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:33.963425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] PATH_INFO: `/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:33.964868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7081fdeabbb49a3a1f10cdf7dc020a8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:33.966830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:33.982800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b840-67d4-4b39-b6c2-8fbd7023781c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:33.988732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:33.989402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:33.989679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:33.989956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] PATH_INFO: `/v3/users/88d1a9e0104d431fbffcd217456c2350` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:33.991580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d1a9e0104d431fbffcd217456c2350)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:33.993554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.033875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'request_id': 'req-21b94584-862a-4dd8-a8de-49f75fc12a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.040695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'request_id': 'req-21b94584-862a-4dd8-a8de-49f75fc12a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.048067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7081fdeabbb49a3a1f10cdf7dc020a8', 'request_id': 'req-21b94584-862a-4dd8-a8de-49f75fc12a74'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.052802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d1a9e0104d431fbffcd217456c2350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.060570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d1a9e0104d431fbffcd217456c2350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.061316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d1a9e0104d431fbffcd217456c2350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.062509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] The token cache is being invalidate because project b7081fdeabbb49a3a1f10cdf7dc020a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:34.062805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.063627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-21b94584-862a-4dd8-a8de-49f75fc12a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.065508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 953/1871] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:33 2022] DELETE /identity/v3/projects/b7081fdeabbb49a3a1f10cdf7dc020a8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:34.070619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82003-3781-4eaa-a74a-8ecac06c0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.070953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82003-3781-4eaa-a74a-8ecac06c0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.071349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff82003-3781-4eaa-a74a-8ecac06c0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.075441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d1a9e0104d431fbffcd217456c2350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.095122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aff82003-3781-4eaa-a74a-8ecac06c0ad3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:34.096341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aff82003-3781-4eaa-a74a-8ecac06c0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.098539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fe7f3ab1-29ef-46a1-8ad9-f8ac7054250a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d1a9e0104d431fbffcd217456c2350'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.107970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 919/1872] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:33 2022] DELETE /identity/v3/users/88d1a9e0104d431fbffcd217456c2350 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:34.112827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.113272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.113967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.133741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:34.134975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.137248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:34.168917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:34.175854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 954/1873] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:34.185350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.186056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.186574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.211770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:34.213563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.226490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 920/1874] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:34.237695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.239899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.327043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 955/1875] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:34.338277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.354493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4c226-a0eb-4a85-8085-964e33d646c9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.363856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.364768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.365027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a8927-7d21-4c32-b6a6-7272d26f63d3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.365387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.365811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.367041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:34.367655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.369796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.376117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.377276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.377563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.377835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.386264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 956/1876] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:34.391046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.393711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.395530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.408475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3b43-9b76-4be7-8ccc-7a09e0a01e21 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.412102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 921/1877] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:34.414673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.415481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.415823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.416098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.417558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.419708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.454372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 957/1878] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:34.459079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.477004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf97e65-9b6f-4c40-9781-89a086f7aba0 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.502116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.504051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.575083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.576127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.576452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.577131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.578369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.580529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.589694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fef22-2b9e-4e0d-8981-c3d5b52bf411 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.597876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.598609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.598949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.599220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] PATH_INFO: `/v3/users/d4489e58d5e040fa87319beb32324224` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.600528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4489e58d5e040fa87319beb32324224)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.602698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.608814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 922/1879] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:34.611587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.627393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3a4c-fc89-4d54-9592-fa5048602651 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.634400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.635217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.635599 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.636814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.637744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.639589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.664434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 923/1880] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:34.664434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.672558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bdef-59bf-4529-9ceb-e4547d7f7e90 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.674332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:34.678609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.679234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.679515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.679806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.680618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.682703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.684574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4489e58d5e040fa87319beb32324224'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.686692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4489e58d5e040fa87319beb32324224'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.700016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 924/1881] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:34.704624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.706304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4489e58d5e040fa87319beb32324224'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.716751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4489e58d5e040fa87319beb32324224'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.718294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2103-5fa8-4b1f-89e6-0fd5c42ea364 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.719123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-174c3285-9e3d-4bdf-8368-1640d0725018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4489e58d5e040fa87319beb32324224'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:34.723672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.724519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.724834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.725165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] PATH_INFO: `/v3/projects/d23ba55400cc420ebd3214c8da0fff6d/users/39018149360f43268c4d2d0c9eaae6a9/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.735847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 958/1882] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:34 2022] DELETE /identity/v3/users/d4489e58d5e040fa87319beb32324224 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:34.740000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.740284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.740602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.747415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23ba55400cc420ebd3214c8da0fff6d, user_id=39018149360f43268c4d2d0c9eaae6a9, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.751057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d846c-f16b-4c5d-90c0-ac785e14241b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.762749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:34.763945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.771570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 925/1883] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:34 2022] PUT /identity/v3/projects/d23ba55400cc420ebd3214c8da0fff6d/users/39018149360f43268c4d2d0c9eaae6a9/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:34.782479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.782874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.784246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.836920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] MFA Rules not processed for user `39018149360f43268c4d2d0c9eaae6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:34.838229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.843310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:34.853704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 959/1884] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:34.863914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.865700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.925247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 926/1885] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:34.929499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.931262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.942252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd498e9-04ff-450e-b6b2-8a4fd0b9b670 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.946996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.947650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.947928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.948197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.950493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cbe2-3da0-45fc-a119-8da6ead6a777 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.955614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:34.956232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:34.956525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:34.956826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:34.958012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.959403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.963233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:34.965316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:34.977548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 960/1886] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:34.978321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:34.979655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:34.993492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 927/1887] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:34.994613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a04a06-66fc-4af4-a070-171e82cffb02 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:34.997562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.065269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.065957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.066260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.066507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] PATH_INFO: `/v3/projects/e2e8a8b290b84ead9eb3fb967ff9937c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.067687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e8a8b290b84ead9eb3fb967ff9937c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.069635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.071765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075625-f417-4e5d-b0be-726aaa6f40a5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.072312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:35.077622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.078424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.078709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.079022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.079815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.081955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.112487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 928/1888] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:34 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:35.117052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.128215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58957681-63ec-4c04-8fb9-656bb397b316 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.150881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e8a8b290b84ead9eb3fb967ff9937c', 'request_id': 'req-3300134e-ac4c-4e7d-ab67-a39371934b3e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.161061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e8a8b290b84ead9eb3fb967ff9937c', 'request_id': 'req-3300134e-ac4c-4e7d-ab67-a39371934b3e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.170113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e8a8b290b84ead9eb3fb967ff9937c', 'request_id': 'req-3300134e-ac4c-4e7d-ab67-a39371934b3e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.188474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] The token cache is being invalidate because project e2e8a8b290b84ead9eb3fb967ff9937c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:35.188899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.189634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.191957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 961/1889] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:34 2022] DELETE /identity/v3/projects/e2e8a8b290b84ead9eb3fb967ff9937c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:35.195916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.197546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.200659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.201456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.201563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.202430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.203280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.205042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.216280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 929/1890] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:12:35.218404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300134e-ac4c-4e7d-ab67-a39371934b3e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.221035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.223076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.223819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.224479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.224796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.225074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] PATH_INFO: `/v3/users/1111c8535a4c43edb2299bb411665e58` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.226423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1111c8535a4c43edb2299bb411665e58)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.228178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.237769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f891e-0311-41e2-af37-4334915ce808 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.242764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.243441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.243709 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.244357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] PATH_INFO: `/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd/users/403059be4cff46baa068350d01d003dd/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.247932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:35.263747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b040ad82584b2c8158dd93e49f3ddd, user_id=403059be4cff46baa068350d01d003dd, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.267193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.284522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 930/1891] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:35 2022] PUT /identity/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd/users/403059be4cff46baa068350d01d003dd/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:35.285233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.287101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.301016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1111c8535a4c43edb2299bb411665e58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.301790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1111c8535a4c43edb2299bb411665e58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.316335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1111c8535a4c43edb2299bb411665e58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.325915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1111c8535a4c43edb2299bb411665e58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.327718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1111c8535a4c43edb2299bb411665e58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.347868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 962/1892] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:35 2022] DELETE /identity/v3/users/1111c8535a4c43edb2299bb411665e58 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:35.348663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.352038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.373344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53192d-cc2c-43ed-aed5-1fe19d4fdd4a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.441177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0d9bf-f101-4adf-a0ba-2df00d69d6f6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.447306 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.448218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.448735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.449315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.450305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.452132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.458831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:35.464614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.465613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.466876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.466876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] PATH_INFO: `/v3/projects/1ed90ffb84a34648b3bd6b04375f3202` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.467854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed90ffb84a34648b3bd6b04375f3202)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.469540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 963/1893] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:35.473830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.474535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.489031 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c790b1-5d4d-4e7b-859c-34f68a409238 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.496143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.500761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.501290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.501586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] PATH_INFO: `/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd/users/403059be4cff46baa068350d01d003dd/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.505360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b040ad82584b2c8158dd93e49f3ddd, user_id=403059be4cff46baa068350d01d003dd, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.509314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a609c1d-77f8-4aec-95dd-b89bbd10a0ad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.540853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 964/1894] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:35 2022] PUT /identity/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd/users/403059be4cff46baa068350d01d003dd/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:35.551343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.551636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.552047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.593011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] MFA Rules not processed for user `403059be4cff46baa068350d01d003dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:35.594376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.601702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed90ffb84a34648b3bd6b04375f3202', 'request_id': 'req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.614102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed90ffb84a34648b3bd6b04375f3202', 'request_id': 'req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.628725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed90ffb84a34648b3bd6b04375f3202', 'request_id': 'req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.652386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] The token cache is being invalidate because project 1ed90ffb84a34648b3bd6b04375f3202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:35.653251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.654470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.657195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 931/1895] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:35 2022] DELETE /identity/v3/projects/1ed90ffb84a34648b3bd6b04375f3202 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:35.662066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.664631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.705644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 965/1896] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:35.714028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:35.785619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bb00-d74f-4ccc-8dc2-e5cf6df26936 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.792977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.792977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.792977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.792977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] PATH_INFO: `/v3/users/38e3b47903504a9b94fa7a57697030fb` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.794002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e3b47903504a9b94fa7a57697030fb)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.796518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.799235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.800880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.819943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1db7-393a-44fa-a6e2-73781bab3d00 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:35.825384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:35.826073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:35.826329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:35.826808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] PATH_INFO: `/v3/users/302f8d57c3b4487c9569f1da421345bd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:35.828554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302f8d57c3b4487c9569f1da421345bd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:35.831523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:35.883632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e3b47903504a9b94fa7a57697030fb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.892250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e3b47903504a9b94fa7a57697030fb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.893184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e3b47903504a9b94fa7a57697030fb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.902196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e3b47903504a9b94fa7a57697030fb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.910963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302f8d57c3b4487c9569f1da421345bd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.912085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302f8d57c3b4487c9569f1da421345bd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.927851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e3b47903504a9b94fa7a57697030fb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.929534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302f8d57c3b4487c9569f1da421345bd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.935654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 932/1897] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:35 2022] DELETE /identity/v3/users/38e3b47903504a9b94fa7a57697030fb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:35.937000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.938590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:35.949224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302f8d57c3b4487c9569f1da421345bd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.949912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302f8d57c3b4487c9569f1da421345bd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:35.985130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 966/1898] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:35 2022] DELETE /identity/v3/users/302f8d57c3b4487c9569f1da421345bd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:35.986290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:35.990071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.051377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec9ba9-3150-4377-9497-221b98a2c2b6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.100848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:36.141814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ee9d-1424-4ac4-8686-c870c62835b6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.153155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.153919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.154305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.154620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] PATH_INFO: `/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.156547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee9f5b0369445ea83f2c31fe9cb84ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.158644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.160088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.162651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.163124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.163601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.166919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.181983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:36.241590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee9f5b0369445ea83f2c31fe9cb84ed', 'request_id': 'req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.248078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee9f5b0369445ea83f2c31fe9cb84ed', 'request_id': 'req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.254738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee9f5b0369445ea83f2c31fe9cb84ed', 'request_id': 'req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.262866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.264604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8c3e1-5ebe-4d37-9cf4-515548619469 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.270365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] The token cache is being invalidate because project dee9f5b0369445ea83f2c31fe9cb84ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:36.271270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.271635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aac2a9d3-900a-4930-afdd-5f5ef4a5cb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.273472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 967/1899] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:35 2022] DELETE /identity/v3/projects/dee9f5b0369445ea83f2c31fe9cb84ed => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:36.274608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.274959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.275326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.279118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 933/1900] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:36.281223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.281519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.281797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.296359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:36.297722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.302950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:36.304541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.385446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 934/1901] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:36.386298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.387605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.388409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 968/1902] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:36.393164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.394775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.400308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8530c38-e13e-43c6-8c4f-f27a8d2d8b35 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.406024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.406668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.406947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.407219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] PATH_INFO: `/v3/projects/168bc69be48f455f94a8914b1d3b9e44` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.408378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=168bc69be48f455f94a8914b1d3b9e44)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.410308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.451413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7d1f-cdf7-425a-a4f6-de217ceaf437 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.465663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168bc69be48f455f94a8914b1d3b9e44', 'request_id': 'req-c4f9aa99-c461-4215-8c78-b787aab46f5e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.472767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168bc69be48f455f94a8914b1d3b9e44', 'request_id': 'req-c4f9aa99-c461-4215-8c78-b787aab46f5e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.479233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168bc69be48f455f94a8914b1d3b9e44', 'request_id': 'req-c4f9aa99-c461-4215-8c78-b787aab46f5e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.487024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:36.493061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] The token cache is being invalidate because project 168bc69be48f455f94a8914b1d3b9e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:36.493506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.494170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c4f9aa99-c461-4215-8c78-b787aab46f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:36.495735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 935/1903] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:36 2022] DELETE /identity/v3/projects/168bc69be48f455f94a8914b1d3b9e44 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:36.496985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.497272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.497549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.511828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.512448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.512766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.513036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.515857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.519034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:36.520209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.547221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:36.575577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.577680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803c77-538d-41dd-ac90-03fca0a2810e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.583331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 936/1904] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:36.584169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.585479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.587058 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 969/1905] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:36.588601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.588907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.589181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.609639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:36.610909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.620973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 970/1906] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:36.627953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.639180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ddd2d-061b-4fe3-9cd9-5fb25ca68f46 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.645732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.646288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.646564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.646835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.647720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29a07c-b582-43dc-aedf-b9aa487046ac None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.647831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:36.648020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.649635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea861c-b679-4455-a4d2-d5534c8f3265 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.651530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.652545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.652545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.652793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.654495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.662939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 971/1907] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:36.664105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.664394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.664690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.667818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.669300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.680133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 937/1908] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:36.680971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.684215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:36.685537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:36.692094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41c892-be81-4fc6-9cb7-efbcd4dbc527 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.695312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 972/1909] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:36.699340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.700036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.700761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.701115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.701460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.702758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.704758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.711107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e4504-7edd-4478-bf46-3c3f46fc857f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.717332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.719655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.723509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.723509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.724091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:36.724557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.726423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.744766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 973/1910] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:12:36.746427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.749302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 938/1911] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:36.754816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.770405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5155a-f64a-467c-99ce-7ac7ff48db1c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.867752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8deed-459c-43f1-9f67-6cc93597e4d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.878275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.879040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.879550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.880197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.880831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.883701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.908136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.908865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.909294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.909611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.910253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:36.912302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:36.928566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 939/1912] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:36.933267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.969283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980e34-0bf8-4b21-bb6d-addcd9fa4d41 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:36.984219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 974/1913] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:36.985569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:36.987409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:36.988662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:36.988969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:36.989240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:36.990094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.008004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.030931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 940/1914] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:37.035817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.057260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64465e-0903-4561-a04e-1735be214e78 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.063432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.116306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.144460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b22db-1f26-4c21-86bb-d9d84d975e83 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.155939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.157571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.158179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.159694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.160853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.164326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.178316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.179107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.180126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.180126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.180620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.182556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.212485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 941/1915] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:37.216416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.235762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146252-6a15-4247-b377-5d7b187aa8db admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.244221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 975/1916] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:36 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:37.244221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.244474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.244474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.244474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.244474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] PATH_INFO: `/v3/projects/9a32768694464451a177f61c14dc3eea/users/98855d63cb7f4918841bc128dc48531a/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.249394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.265298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a32768694464451a177f61c14dc3eea, user_id=98855d63cb7f4918841bc128dc48531a, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.266607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5842057-1fc3-4b61-8d8c-c8fc236c4a6e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.268238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.279204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.280749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.280944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.281286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] PATH_INFO: `/v3/users/7b454cbf0bc145a4a877f91ce287d8bf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.283239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b454cbf0bc145a4a877f91ce287d8bf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.286059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.287351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 942/1917] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:37 2022] PUT /identity/v3/projects/9a32768694464451a177f61c14dc3eea/users/98855d63cb7f4918841bc128dc48531a/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:37.288608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.389970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245788e-c910-4f59-a66b-456566a5ed20 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.397081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.398188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.398468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.399869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.402011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.404053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b454cbf0bc145a4a877f91ce287d8bf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.405707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b454cbf0bc145a4a877f91ce287d8bf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.407322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.424090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b454cbf0bc145a4a877f91ce287d8bf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.429429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 943/1918] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:37.430902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.433342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.436151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b454cbf0bc145a4a877f91ce287d8bf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.437464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84f7e670-0ebc-4bc5-8723-7c650338e56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b454cbf0bc145a4a877f91ce287d8bf'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.449126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f680ac-0721-4124-93d9-29cd2376763b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.455525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.456305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.456672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.457040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] PATH_INFO: `/v3/projects/5f231bad842144eaa300cc6ba45e7e34` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.458322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f231bad842144eaa300cc6ba45e7e34)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.458507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 976/1919] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:37 2022] DELETE /identity/v3/users/7b454cbf0bc145a4a877f91ce287d8bf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:37.460134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e153a7-caf4-45ee-9392-1515a575ad38 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.460624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.460749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e153a7-caf4-45ee-9392-1515a575ad38 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.461360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e153a7-caf4-45ee-9392-1515a575ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.504352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-59e153a7-caf4-45ee-9392-1515a575ad38 None None] MFA Rules not processed for user `98855d63cb7f4918841bc128dc48531a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:37.505703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-59e153a7-caf4-45ee-9392-1515a575ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.531868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f231bad842144eaa300cc6ba45e7e34', 'request_id': 'req-93185936-d1a7-432d-8480-61f841fbb0e3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.540957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f231bad842144eaa300cc6ba45e7e34', 'request_id': 'req-93185936-d1a7-432d-8480-61f841fbb0e3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.550120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f231bad842144eaa300cc6ba45e7e34', 'request_id': 'req-93185936-d1a7-432d-8480-61f841fbb0e3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.565654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] The token cache is being invalidate because project 5f231bad842144eaa300cc6ba45e7e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:37.565927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.566569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.568269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 944/1920] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:37 2022] DELETE /identity/v3/projects/5f231bad842144eaa300cc6ba45e7e34 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:37.569135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.572533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.584845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 977/1921] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:37.588076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.588548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.589061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.600373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.611078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:37.612292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.628988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.643080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185936-d1a7-432d-8480-61f841fbb0e3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.647722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.648569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.648885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.649163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.649860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.651466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.662290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 945/1922] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:37.663311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.664997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.677825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 978/1923] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:37.678665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.678898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88ad80-90ce-428a-904e-65c40e515236 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.679916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.684191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.685083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.685368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.685645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] PATH_INFO: `/v3/users/c38b988021444370a0b6a3841783f4f7` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.687807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38b988021444370a0b6a3841783f4f7)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.689808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.739917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d8804-a9f9-45ab-a2de-8bd7d8d6b045 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.740395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38b988021444370a0b6a3841783f4f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.744185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.744832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.745118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.745392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.747873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38b988021444370a0b6a3841783f4f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.748583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38b988021444370a0b6a3841783f4f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.757304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38b988021444370a0b6a3841783f4f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.771973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38b988021444370a0b6a3841783f4f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:37.778891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 946/1924] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:37 2022] DELETE /identity/v3/users/c38b988021444370a0b6a3841783f4f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:37.781940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.784162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.820768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.822454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.834438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 979/1925] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:37.835341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.837735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.884878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4410-7bcf-4834-92ab-36e413273b84 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.890279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.890964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.891274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.891520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] PATH_INFO: `/v3/projects/74658d73c6e74b9d99fe51cbe3f4e65f/users/1d629daa9f124ba8aa1c7c1b8415e45e/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.909728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74658d73c6e74b9d99fe51cbe3f4e65f, user_id=1d629daa9f124ba8aa1c7c1b8415e45e, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:37.912834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:37.918132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104a1a-107d-40f7-8750-91a899dc9f39 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:37.932304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 947/1926] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:37 2022] PUT /identity/v3/projects/74658d73c6e74b9d99fe51cbe3f4e65f/users/1d629daa9f124ba8aa1c7c1b8415e45e/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:37.934380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:37.937231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:37.956097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.968114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:37.995462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:37.996092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:37.996452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:37.996629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:37.998796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.011506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.012977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bd1c-5427-41fe-baab-6d9e31976d3c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.018738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82cfcb-ea6d-4af7-8d00-18106ce24920 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.023484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.024261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.024542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.024975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 980/1927] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:38.025108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] PATH_INFO: `/v3/users/98855d63cb7f4918841bc128dc48531a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.026065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce247cf-19c0-4461-a7ad-33a8d52ab650 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.026193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98855d63cb7f4918841bc128dc48531a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.026330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce247cf-19c0-4461-a7ad-33a8d52ab650 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.026593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce247cf-19c0-4461-a7ad-33a8d52ab650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.028178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.062907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7ce247cf-19c0-4461-a7ad-33a8d52ab650 None None] MFA Rules not processed for user `1d629daa9f124ba8aa1c7c1b8415e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:38.065210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7ce247cf-19c0-4461-a7ad-33a8d52ab650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.131433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98855d63cb7f4918841bc128dc48531a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.144374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98855d63cb7f4918841bc128dc48531a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.145105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98855d63cb7f4918841bc128dc48531a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.158888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98855d63cb7f4918841bc128dc48531a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.173633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98855d63cb7f4918841bc128dc48531a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.185592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 948/1928] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:37 2022] DELETE /identity/v3/users/98855d63cb7f4918841bc128dc48531a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:38.187157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.188944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.209329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 981/1929] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:38.209329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.209329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.209329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.234441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:38.236677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.293829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac49d9-e598-4abd-bdd1-c919f5304a24 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.303047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.303727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.304003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.305057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] PATH_INFO: `/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.306393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc49cdbac0b54818bb8c7e5c33f052e8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.308986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.334000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 982/1930] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:38.335317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.336812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.351896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427383ab-b20e-408c-b5d5-99c230f0f1a6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.358911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.359554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.359822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.360092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.360839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.364471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.369464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:38.392447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc49cdbac0b54818bb8c7e5c33f052e8', 'request_id': 'req-a9c5258b-1f8e-447e-a134-1e4609cd1702'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.405033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc49cdbac0b54818bb8c7e5c33f052e8', 'request_id': 'req-a9c5258b-1f8e-447e-a134-1e4609cd1702'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.421778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc49cdbac0b54818bb8c7e5c33f052e8', 'request_id': 'req-a9c5258b-1f8e-447e-a134-1e4609cd1702'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.432963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 983/1931] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:38.435258 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.439629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.462494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] The token cache is being invalidate because project cc49cdbac0b54818bb8c7e5c33f052e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:38.463803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.465948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.470472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 949/1932] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:38 2022] DELETE /identity/v3/projects/cc49cdbac0b54818bb8c7e5c33f052e8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:38.471748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.477035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.521988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:38.539480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03c113-abef-456b-8ac2-ad616889753b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.549965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.550644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.551117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.551393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.554422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.588716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5258b-1f8e-447e-a134-1e4609cd1702 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.663085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.663935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.664400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.664843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.665612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.667657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.676986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.678473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d92dc4-c779-47b6-91a2-d26b494282a5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.695207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 984/1933] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:38.697429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.697762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.698028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.699446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 950/1934] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:38.703201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.705192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.718018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652fcbb-b837-45dd-8400-78f0020fc0c4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.723680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.724833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.725260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.725691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] PATH_INFO: `/v3/projects/547c4007deea475b973c1fc5215fb9b1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.727592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547c4007deea475b973c1fc5215fb9b1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.730215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.734481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:38.738895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.754943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 985/1935] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:38.756449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.770050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222ee5-2f3e-44e8-98d3-bd49031b4723 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.776414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.777256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.777644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.778014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.778891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.781318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf788-e846-4545-942d-b3a2aa30bf3f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.797466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 986/1936] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:38.798296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547c4007deea475b973c1fc5215fb9b1', 'request_id': 'req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.799234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.799627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.799998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.806402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547c4007deea475b973c1fc5215fb9b1', 'request_id': 'req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.808411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:38.827248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:38.827248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.832494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547c4007deea475b973c1fc5215fb9b1', 'request_id': 'req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.850242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] The token cache is being invalidate because project 547c4007deea475b973c1fc5215fb9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:38.850535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.860005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:38.868095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 951/1937] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:38 2022] DELETE /identity/v3/projects/547c4007deea475b973c1fc5215fb9b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:38.869874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.874149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.942695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 987/1938] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:38.944262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:38.946017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:38.963715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4b3e-cac2-4844-b369-4ad1f6416a68 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.969937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.970799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.971181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.971555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] PATH_INFO: `/v3/users/2efececae27941e4a0e73a0e9d4e96e9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:38.972958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1eabe-f4e3-40e8-b4d9-4bfc020a2f63 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:38.973092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efececae27941e4a0e73a0e9d4e96e9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:38.975457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:38.978878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:38.979738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:38.980022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:38.980348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] PATH_INFO: `/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1/users/39364fdec68b45cbb2ff46527014d65a/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.014867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbc7db117724edcbe3caca0db4ac1a1, user_id=39364fdec68b45cbb2ff46527014d65a, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.020049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.058308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 952/1939] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:38 2022] PUT /identity/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1/users/39364fdec68b45cbb2ff46527014d65a/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:39.059182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.100972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efececae27941e4a0e73a0e9d4e96e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.102815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efececae27941e4a0e73a0e9d4e96e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.125740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efececae27941e4a0e73a0e9d4e96e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.141721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efececae27941e4a0e73a0e9d4e96e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.142532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efececae27941e4a0e73a0e9d4e96e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.144322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:39.169467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 988/1940] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:38 2022] DELETE /identity/v3/users/2efececae27941e4a0e73a0e9d4e96e9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:39.175111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.178668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:39.208535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674d9e-777f-4934-b990-80f6cf2c007b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.386947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89adce-9325-4d62-8b7f-b193504e0abc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.408151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.409873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.410527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.410806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.411079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.411190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.411781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:39.412085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.412204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.412538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.413738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.415100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.429379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.446801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 953/1941] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:39.447497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.450892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:39.459895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 989/1942] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:39.463842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.479888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:39.487263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7f94-eb91-47e6-865b-763304d50c19 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.498509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.499188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.499468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.500336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] PATH_INFO: `/v3/projects/9a32768694464451a177f61c14dc3eea` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.503539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a32768694464451a177f61c14dc3eea)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.505500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.507397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:39.515785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449d39-0030-4064-b96b-612583209707 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.527682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.528353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.528633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.528930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.529627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.532225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.593809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a32768694464451a177f61c14dc3eea', 'request_id': 'req-c196be5b-edcc-4eec-ab4f-4badbd83af9f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.609216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 990/1943] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:39 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:39.609216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.611268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a32768694464451a177f61c14dc3eea', 'request_id': 'req-c196be5b-edcc-4eec-ab4f-4badbd83af9f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.628495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a32768694464451a177f61c14dc3eea', 'request_id': 'req-c196be5b-edcc-4eec-ab4f-4badbd83af9f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.650331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] The token cache is being invalidate because project 9a32768694464451a177f61c14dc3eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:39.650619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.652998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:39.658017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 954/1944] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:39 2022] DELETE /identity/v3/projects/9a32768694464451a177f61c14dc3eea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:39.661461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:39.664410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:39.739959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d5db6-07d8-4ccc-aa55-4ce7c4e53dd8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.753595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.755238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.756040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.756438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] PATH_INFO: `/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1/users/39364fdec68b45cbb2ff46527014d65a/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.759504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbc7db117724edcbe3caca0db4ac1a1, user_id=39364fdec68b45cbb2ff46527014d65a, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.763152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9cdd-4355-4c97-98cc-773dc7439e63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.776509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196be5b-edcc-4eec-ab4f-4badbd83af9f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:39.776783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 991/1945] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:39 2022] PUT /identity/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1/users/39364fdec68b45cbb2ff46527014d65a/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:39.778382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cef29-59a3-449a-a2a8-2c6d80896a11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.778745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cef29-59a3-449a-a2a8-2c6d80896a11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.779179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cef29-59a3-449a-a2a8-2c6d80896a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.825261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-300cef29-59a3-449a-a2a8-2c6d80896a11 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:39.827657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-300cef29-59a3-449a-a2a8-2c6d80896a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:39.935046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:39.935511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.935790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.936326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:39.937321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:39.942149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff0e35-5d5b-426b-9645-8d56da33689d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:39.946584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:39.971706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 992/1946] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:39.971706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:39.971706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:39.971706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.000182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 955/1947] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:39 2022] POST /identity/v3/users => generated 284 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:40.005630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.005914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.006233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.035154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:40.036385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.038178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] MFA Rules not processed for user `39364fdec68b45cbb2ff46527014d65a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:40.042389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.050761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 956/1948] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:40.052863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.072155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259bac-bbad-4694-8a98-364a0ed19ae9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.102535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.103182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.103465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.103766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.104479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.112780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99100c15-b9e4-4ba2-9a24-2e81b2770fb2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.127988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 957/1949] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:40.129861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849f9-07a7-4431-baad-6589b20a3f3b None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.130555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849f9-07a7-4431-baad-6589b20a3f3b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.131045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849f9-07a7-4431-baad-6589b20a3f3b None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.133531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 958/1950] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:12:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:12:40.141159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129849f9-07a7-4431-baad-6589b20a3f3b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.155932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129849f9-07a7-4431-baad-6589b20a3f3b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.163812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.164104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.164552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.164926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.165705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:40.166593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.168428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0200-3beb-48b9-b71c-cc6f2cc45e08 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.171910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:40.183997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 993/1951] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:40.185114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.192697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 959/1952] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:40.201393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805008-1354-432f-9435-21604b3a970a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.202201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805008-1354-432f-9435-21604b3a970a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.202486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805008-1354-432f-9435-21604b3a970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.207731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42b2ac-f219-40ef-be45-723386a7aa54 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.216200 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.218445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.219077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.219498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.220420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.223454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.240544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 994/1953] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:40.242790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.245817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-da805008-1354-432f-9435-21604b3a970a None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:40.247414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-da805008-1354-432f-9435-21604b3a970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.247640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.345569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 960/1954] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:40.347659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805008-1354-432f-9435-21604b3a970a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.363100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805008-1354-432f-9435-21604b3a970a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.364035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a302-ef96-4970-8456-c739a419555b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.368713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.369569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.369824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.370111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.370376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.371046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.371527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.372010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.372472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.374751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.388350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.391091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.405776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 995/1955] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:40.406117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.407517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.416036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 961/1956] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:40.417207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.422449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50550-dd51-4f43-9600-8701f67dff8f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.500975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.513105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.513439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.513915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] PATH_INFO: `/v3/projects/d5c1e7571b8246dda797f34854659bd2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.515699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c73fb-d164-407e-8198-2d95d4201910 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.530080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c1e7571b8246dda797f34854659bd2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.530279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.530279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.530279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.530507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.530578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] PATH_INFO: `/v3/projects/652abb9c45af4bcba8477b9aa20b0f48/users/364d2f6943f9434292bef4657a1d4f37/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.539160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652abb9c45af4bcba8477b9aa20b0f48, user_id=364d2f6943f9434292bef4657a1d4f37, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.542325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.562729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 962/1957] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:40 2022] PUT /identity/v3/projects/652abb9c45af4bcba8477b9aa20b0f48/users/364d2f6943f9434292bef4657a1d4f37/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:40.572744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.575244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:40.613220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c1e7571b8246dda797f34854659bd2', 'request_id': 'req-089e7bc1-c92d-4f10-82d5-38fb7d666701'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:40.620447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c1e7571b8246dda797f34854659bd2', 'request_id': 'req-089e7bc1-c92d-4f10-82d5-38fb7d666701'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:40.626963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c1e7571b8246dda797f34854659bd2', 'request_id': 'req-089e7bc1-c92d-4f10-82d5-38fb7d666701'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:40.628012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:40.646789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d7b4-c9f1-4508-9d52-c9b06cafb2c3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.647001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] The token cache is being invalidate because project d5c1e7571b8246dda797f34854659bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:40.647001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:40.647001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:40.648093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 996/1958] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:40 2022] DELETE /identity/v3/projects/d5c1e7571b8246dda797f34854659bd2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:40.648906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.650209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.712972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.713807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.714189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.714852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.715647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.719103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.719283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7bc1-c92d-4f10-82d5-38fb7d666701 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.723009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.723646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.723921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.724187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.726324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.753957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 963/1959] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:40.755820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:40.759196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.815331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.818174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f384e78-fc29-4f98-8c2e-f4af4b255f48 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.829957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 997/1960] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:40.831592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.832175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.832771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.886751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] MFA Rules not processed for user `364d2f6943f9434292bef4657a1d4f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:40.888158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.903159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee217-f12a-4b1d-8f39-2b523f987577 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:40.912506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:40.913691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.913977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.914439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:40.916941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:40.936853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:40.939103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7e6ed-17dc-426f-bd4e-8023aeb3c15f service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:40.965518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 964/1961] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:40.967278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:40.967571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:40.967864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.006098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:41.049103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 998/1962] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:41.050602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.052234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.055741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:41.057006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.085009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 965/1963] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:41.090286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d2a0-d9af-4bda-8256-1bcf4b1909a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.093757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.097851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.103900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.104785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.105227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.107276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.110426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.113330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.115261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeb2e1-8515-458e-890f-e7ed3cebcb64 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.128715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.129055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 999/1964] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:41.129055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.129205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.129281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.130206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] PATH_INFO: `/v3/users/39018149360f43268c4d2d0c9eaae6a9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.132407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39018149360f43268c4d2d0c9eaae6a9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.133481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.134871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.150968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca93e-622c-4b71-ba67-b87f7353893e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.159528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.160751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.160751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.160751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.161324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.163289 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b704192-d7f2-4873-9384-532fb3344f9c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.210469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39018149360f43268c4d2d0c9eaae6a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.213024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1000/1965] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:41.214217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.214504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.214778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.221871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39018149360f43268c4d2d0c9eaae6a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.223124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39018149360f43268c4d2d0c9eaae6a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.226022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:41.241642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39018149360f43268c4d2d0c9eaae6a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.247368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:41.248783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.269138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39018149360f43268c4d2d0c9eaae6a9'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.283343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 966/1966] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:41 2022] DELETE /identity/v3/users/39018149360f43268c4d2d0c9eaae6a9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:41.284203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.285795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.327204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1001/1967] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:41.328679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.330176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.347214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec90f4-d217-46f6-adb2-4f991d15f51c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.373763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd2b1d-9109-437f-91a4-40f7ecdaac10 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.380971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.382028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.383127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.383789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.384751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.387475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.406596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 967/1968] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:41.407344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.409847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.424569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e85b-6f72-4679-b602-d80333fd9bec admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.439902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.440217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.440682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.440799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] PATH_INFO: `/v3/users/1d629daa9f124ba8aa1c7c1b8415e45e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.443735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d629daa9f124ba8aa1c7c1b8415e45e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.447114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.450520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.451210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.452062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.452485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.453883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.457327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54655fa-cca1-4f87-997c-b28082d5a679 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.489660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1002/1969] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:41.491384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.491944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.492749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.516136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:41.517810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.528863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1003/1970] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:41.531322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.540073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d629daa9f124ba8aa1c7c1b8415e45e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.549389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e429-e370-48f2-8468-aefc1a62e994 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.550270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d629daa9f124ba8aa1c7c1b8415e45e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.551999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d629daa9f124ba8aa1c7c1b8415e45e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.554319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.555425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.560868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.562247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.563367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:41.563917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.567663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.575994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d629daa9f124ba8aa1c7c1b8415e45e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.606673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d629daa9f124ba8aa1c7c1b8415e45e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:41.609430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1004/1971] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:41.610294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.618608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.631595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 968/1972] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:41 2022] DELETE /identity/v3/users/1d629daa9f124ba8aa1c7c1b8415e45e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:41.632557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.635208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.643845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e325e-f585-4360-83c9-1ad59118878a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.683068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:41.697546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:41.726623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95502ac-3ef6-488a-aaea-5d4d2c372b0e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.736822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.738270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.740111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.741282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.743712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.746557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.747348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.747682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.748491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.748880 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] PATH_INFO: `/v3/projects/bae3b33e3275431c8bd3757662f3d1ae/users/8b4296b9c2f04b5db933d3cfde543d76/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.776545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 969/1973] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:41.776545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.781953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.783527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae3b33e3275431c8bd3757662f3d1ae, user_id=8b4296b9c2f04b5db933d3cfde543d76, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.788999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.837000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1005/1974] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:41 2022] PUT /identity/v3/projects/bae3b33e3275431c8bd3757662f3d1ae/users/8b4296b9c2f04b5db933d3cfde543d76/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:41.838392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:41.855265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:41.911978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d34967-7305-4f4c-a7e2-7694beb97c98 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.952842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cf7ef-11ad-4dc3-91d5-edc5c42e6eaa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:41.958286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.958924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.959208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.959780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.960150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:41.962504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78a88c-df7a-44db-9d24-7e34fdb9a72b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:41.990277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1006/1975] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:41.993943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:41.994581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.994711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4602-a673-4089-ba75-91a7333f45e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:41.994874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.994978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4602-a673-4089-ba75-91a7333f45e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:41.995231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4602-a673-4089-ba75-91a7333f45e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.995374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:41.997488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.009928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.011435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.015010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c4cc4602-a673-4089-ba75-91a7333f45e3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:42.016199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4cc4602-a673-4089-ba75-91a7333f45e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.021668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 970/1976] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:42.022439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.031337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400d8a-17a2-4627-a35c-1ebcc2ce612c service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.091898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1007/1977] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:42.093555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.093993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.094439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.112897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.113720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.114071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.114470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] PATH_INFO: `/v3/projects/c6f21100bb454fff954f3093273b3edc/users/7ecac848dbfb47d6a5a26b0250f13bc1/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.137831 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f21100bb454fff954f3093273b3edc, user_id=7ecac848dbfb47d6a5a26b0250f13bc1, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.141197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.150362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] MFA Rules not processed for user `8b4296b9c2f04b5db933d3cfde543d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:42.151763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.163104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 971/1978] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:42 2022] PUT /identity/v3/projects/c6f21100bb454fff954f3093273b3edc/users/7ecac848dbfb47d6a5a26b0250f13bc1/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:42.165115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.189962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:42.207530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:42.269138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1008/1979] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:42.270479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.273020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.275073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7430-c650-4eb2-b3d3-9d4aeeb7afaf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.281330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.281970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.282255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.282534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.283203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.285157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.312327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 972/1980] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:42 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:42.313561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.335581 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc193e8-bb52-4b1f-b9bf-1b57ee14cf0e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.343084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.343728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.344009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.344281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.345022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.346629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.359968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 973/1981] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:42.360962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.363209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.381732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51114-8fa4-4cbf-8f93-d6a2468881a6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.449274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.449942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.450183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.450568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.461494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.463498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.473642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1009/1982] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:42.474564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.484385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a37e0-2fcc-44d7-835e-fe3a91422650 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.486339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2942d-ec06-465e-b637-54bd45a28b28 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.489366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.489987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.490267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.490370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.490544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.491101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.491322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.491429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.491609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.493126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.510846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1010/1983] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:42.511731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.522131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f57b00-d58f-40be-9ce3-ecefcaf96309 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.526986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.527687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.528441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.528441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] PATH_INFO: `/v3/projects/c6f21100bb454fff954f3093273b3edc/users/7ecac848dbfb47d6a5a26b0250f13bc1/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.531126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f21100bb454fff954f3093273b3edc, user_id=7ecac848dbfb47d6a5a26b0250f13bc1, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.534115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.553128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1011/1984] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:42 2022] PUT /identity/v3/projects/c6f21100bb454fff954f3093273b3edc/users/7ecac848dbfb47d6a5a26b0250f13bc1/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:42.553128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.553128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.573583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.575067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.587586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 974/1985] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:42.588334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.600800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3b5b3-4551-4784-8a48-f2c0b3a8fddf service glance] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.645898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:42.684828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27ff0-f8af-4a66-b434-95e5ac948271 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.685523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.686165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.689778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.690075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.691590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.693311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e423da-e0aa-434c-8ed2-25dd6983a948 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.693527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.694616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.695062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.695488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] PATH_INFO: `/v3/projects/d23ba55400cc420ebd3214c8da0fff6d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.696949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23ba55400cc420ebd3214c8da0fff6d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.699607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.702117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:42.707731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 975/1986] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:42.709559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.709849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.710132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.752693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] MFA Rules not processed for user `7ecac848dbfb47d6a5a26b0250f13bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:42.765152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.775036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23ba55400cc420ebd3214c8da0fff6d', 'request_id': 'req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:42.788338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23ba55400cc420ebd3214c8da0fff6d', 'request_id': 'req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:42.796838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23ba55400cc420ebd3214c8da0fff6d', 'request_id': 'req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:42.812120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] The token cache is being invalidate because project d23ba55400cc420ebd3214c8da0fff6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:42.812727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:42.813899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:42.816768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1012/1987] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:42 2022] DELETE /identity/v3/projects/d23ba55400cc420ebd3214c8da0fff6d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:42.817770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.819454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.913338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 976/1988] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:42.914520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.926086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:42.930005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc5b5-9494-4dbc-aef0-12dc5c9e1037 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.935297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.936070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.936361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.936662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] PATH_INFO: `/v3/projects/d9cb1849f4ea444fb9b1e4ef8bac2567/users/d6aa4650790c41bab7e1f5a012562fda/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.941789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c317-6222-4d18-a979-3486e99acd9e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:42.947753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:42.948907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:42.949183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:42.949456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] PATH_INFO: `/v3/users/403059be4cff46baa068350d01d003dd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:42.950889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] RBAC: Authorizing `identity:delete_user(user_id=403059be4cff46baa068350d01d003dd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.953996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.957178 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cb1849f4ea444fb9b1e4ef8bac2567, user_id=d6aa4650790c41bab7e1f5a012562fda, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:42.960021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:42.979844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1013/1989] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:42 2022] PUT /identity/v3/projects/d9cb1849f4ea444fb9b1e4ef8bac2567/users/d6aa4650790c41bab7e1f5a012562fda/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:42.980842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:42.992826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.036824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403059be4cff46baa068350d01d003dd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.052132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403059be4cff46baa068350d01d003dd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.052951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403059be4cff46baa068350d01d003dd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.064434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403059be4cff46baa068350d01d003dd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.110453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403059be4cff46baa068350d01d003dd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.122418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 977/1990] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:42 2022] DELETE /identity/v3/users/403059be4cff46baa068350d01d003dd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:43.122418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:43.122715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee7ea1-3d31-4f5c-989d-17f031f5bfc8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.135618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.163990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:43.203411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:43.257659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.258868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.259202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.259478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] PATH_INFO: `/v3/projects/74658d73c6e74b9d99fe51cbe3f4e65f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.261319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74658d73c6e74b9d99fe51cbe3f4e65f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:43.264432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:43.303677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa421a6-f240-4e83-98ad-37ee9fbf329c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.313575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.314642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.315197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.315428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.320100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.342675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74658d73c6e74b9d99fe51cbe3f4e65f', 'request_id': 'req-608cda3a-f896-49bc-9e84-60ce8ea096b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.351405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74658d73c6e74b9d99fe51cbe3f4e65f', 'request_id': 'req-608cda3a-f896-49bc-9e84-60ce8ea096b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.379317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74658d73c6e74b9d99fe51cbe3f4e65f', 'request_id': 'req-608cda3a-f896-49bc-9e84-60ce8ea096b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.412887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] The token cache is being invalidate because project 74658d73c6e74b9d99fe51cbe3f4e65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:43.413423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.414527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-608cda3a-f896-49bc-9e84-60ce8ea096b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.420490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1014/1991] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:42 2022] DELETE /identity/v3/projects/74658d73c6e74b9d99fe51cbe3f4e65f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:43.422551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.422835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.423282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.469550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:43.470776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:43.491750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 978/1992] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:43.494464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:43.497120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.514827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] MFA Rules not processed for user `d6aa4650790c41bab7e1f5a012562fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:43.518971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.530930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeefb5-3b42-4490-a3b9-b64b29f5535a service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.697166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1015/1993] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:43.698092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:43.702682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.714202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.714202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.714475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.717147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] PATH_INFO: `/v3/users/39364fdec68b45cbb2ff46527014d65a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.717147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39364fdec68b45cbb2ff46527014d65a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:43.719543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:43.784414 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39364fdec68b45cbb2ff46527014d65a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.787899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:43.796462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39364fdec68b45cbb2ff46527014d65a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.797608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39364fdec68b45cbb2ff46527014d65a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.807330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39364fdec68b45cbb2ff46527014d65a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.808933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61c15-e44c-45be-bbfe-6e539178f89f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.813093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.813710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.813983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.814253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.816009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.821784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39364fdec68b45cbb2ff46527014d65a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:43.823405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:43.830051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 979/1994] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:43 2022] DELETE /identity/v3/users/39364fdec68b45cbb2ff46527014d65a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:43.831423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:43.832957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.918293 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:43.921551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:43.945447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1016/1995] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:43.946672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:43.948626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:43.959950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629045d1-fa27-436d-9920-b7d3ceb8273c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.967331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.968347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.968801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.969214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.970099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:43.972627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:43.977748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e231-3e82-4a8d-8068-fe3fb53b25ac service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:43.985413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:43.986079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:43.986368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:43.986750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] PATH_INFO: `/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:43.988198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b040ad82584b2c8158dd93e49f3ddd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.001931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.011386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 980/1996] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:43 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:44.015963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.090424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b040ad82584b2c8158dd93e49f3ddd', 'request_id': 'req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.099362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b040ad82584b2c8158dd93e49f3ddd', 'request_id': 'req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.106849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b040ad82584b2c8158dd93e49f3ddd', 'request_id': 'req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.130267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] The token cache is being invalidate because project b6b040ad82584b2c8158dd93e49f3ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:44.131330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.132868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-086d6ed8-bf71-4df8-9ae6-f54c348c41c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.135567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1017/1997] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:43 2022] DELETE /identity/v3/projects/b6b040ad82584b2c8158dd93e49f3ddd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:44.141495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7544-5c71-4156-860b-8899d7470f81 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.142090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7544-5c71-4156-860b-8899d7470f81 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.143017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f7544-5c71-4156-860b-8899d7470f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.146729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678920ac-cdd2-4f37-ad65-2867c4d211e8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.169933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d88f7544-5c71-4156-860b-8899d7470f81 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:44.172039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d88f7544-5c71-4156-860b-8899d7470f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.237743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.238898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.240109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.240388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.242493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.247249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.261238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1018/1998] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:44.263668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.263994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.264320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.316787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:44.317950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.339072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 981/1999] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:44.346021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.353527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1019/2000] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:44.353737 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.353830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.360160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.385976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b908-e4a0-4a6c-a059-6f57aaf493a5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.404432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c6153-9e6b-42b0-969e-04ebe8a757a8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.416553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.417259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.417538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.417808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] PATH_INFO: `/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.423001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbc7db117724edcbe3caca0db4ac1a1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.425130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.425295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.433925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.434517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.434804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.435661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.445928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.446079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:44.463059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 982/2001] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:44.464862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.493260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f6ca2-c69d-414c-a9ad-1b6dfab185ee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.501013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.501981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.502698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.503089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.504177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:44.504587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.506741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.510219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:44.529421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 983/2002] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:44.530732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbc7db117724edcbe3caca0db4ac1a1', 'request_id': 'req-3c8d1c99-ac82-46db-bfee-ef678389d8ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.531325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.541719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbc7db117724edcbe3caca0db4ac1a1', 'request_id': 'req-3c8d1c99-ac82-46db-bfee-ef678389d8ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.552351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827efb-9704-476b-bba4-af6852896f6e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.553134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbc7db117724edcbe3caca0db4ac1a1', 'request_id': 'req-3c8d1c99-ac82-46db-bfee-ef678389d8ea'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.588418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] The token cache is being invalidate because project fbbc7db117724edcbe3caca0db4ac1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:44.588665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.589886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:44.592797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1020/2003] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:44 2022] DELETE /identity/v3/projects/fbbc7db117724edcbe3caca0db4ac1a1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:44.594540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.602568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.660083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.661979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.662444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.663071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.665015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.666882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72db19-8995-44e1-b1ed-22f059364a23 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.681451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 984/2004] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:44.681451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.681451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.681451 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.700671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:44.702400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.702733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d1c99-ac82-46db-bfee-ef678389d8ea admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.707761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.708491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.708861 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.709236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.710015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.711189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 985/2005] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:44.712735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.714174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c450a4-03ec-4def-8bd6-1940079877d6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.714613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.728532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1904c-f35a-4b92-8d94-4555e02c5298 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.733688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.734554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.734777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.735099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] PATH_INFO: `/v3/projects/dd89465b65d74dd19953dc9f8d3ddbc6/users/8b8fb06b8fc0487aa56e3cb14c4e5a4f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.752398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1021/2006] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:44.754628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc719aa1-9ca0-4047-870e-06197b1f0ef7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.754957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd89465b65d74dd19953dc9f8d3ddbc6, user_id=8b8fb06b8fc0487aa56e3cb14c4e5a4f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.755227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc719aa1-9ca0-4047-870e-06197b1f0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.755644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc719aa1-9ca0-4047-870e-06197b1f0ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.758013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.774204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 986/2007] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:44 2022] PUT /identity/v3/projects/dd89465b65d74dd19953dc9f8d3ddbc6/users/8b8fb06b8fc0487aa56e3cb14c4e5a4f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:44.775226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.786627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dc719aa1-9ca0-4047-870e-06197b1f0ef7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:44.787900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc719aa1-9ca0-4047-870e-06197b1f0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.851948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b174d4-4431-44c7-a175-f65525f84ec3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.856933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1022/2008] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:44.857069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.857818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.858099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.858403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.859652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.859782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.859782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.860300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.861209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.886005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 987/2009] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:44.886896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.902585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779dd70-0b5e-44f4-a06a-14d6a7f6f34f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.907693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.908333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.908614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.908935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.909638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:44.910101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.911707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.911846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] MFA Rules not processed for user `8b8fb06b8fc0487aa56e3cb14c4e5a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:44.913020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:44.922598 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:44.930685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 988/2010] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:44.931541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.943421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d92324-1129-4b5e-a1ff-1b8c4c6be507 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.948028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.948793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.949073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.949372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.950062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.952311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.962896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 989/2011] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:44.963688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.973264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34ce1-332f-41f5-aff3-a0ef2e3c3bcd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:44.978019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:44.978615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:44.979061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:44.979193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:44.979830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:44.981887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:44.984111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1023/2012] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:44.985012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:44.998895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2ec24-1e21-4cc3-82f3-126ada476b7e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.003494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.004129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.004410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.004708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.005405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.006988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.018335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1024/2013] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.019130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.027083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 990/2014] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:44 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.027937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.028840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b298-63db-44f5-abba-ac2e7b076d43 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.034960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:45.097092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.097623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.097902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.098170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.098822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.100792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.101219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089b16-6d91-4911-bbdd-56d6fd5d28ed admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.105879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.106559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.106836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.107110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] PATH_INFO: `/v3/projects/cebff159906e4ac1bc913d51315874ae/users/0dde83e1287e4a0480a8e07d05367e30/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.124784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebff159906e4ac1bc913d51315874ae, user_id=0dde83e1287e4a0480a8e07d05367e30, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.127631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.134487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1025/2015] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.135361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.144395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 991/2016] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:45 2022] PUT /identity/v3/projects/cebff159906e4ac1bc913d51315874ae/users/0dde83e1287e4a0480a8e07d05367e30/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:45.145369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.211292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331340c-040f-4432-9c97-666037c35941 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.211545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425a6c2-c2b1-4dab-bd47-e03542799536 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.216530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.216908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.217327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.217548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.217648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.217826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.217915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.218097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.218535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.218747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.220439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.220653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662b1e-3690-451b-9550-e4b92f04c2d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.249355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 992/2017] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.250808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.251212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.251493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.254750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1026/2018] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.255444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.265218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa273c1-e94d-4d64-8cd3-c6af8fb321c6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.269825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.270420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.270717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.270968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.271651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.273260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.281813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] MFA Rules not processed for user `0dde83e1287e4a0480a8e07d05367e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:45.283043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:45.286679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1027/2019] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.286679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.289118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:45.294541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059851f9-3dec-44b4-a654-fe710bd3cddf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.301057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.301674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.301956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.302230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.302932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.304696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.321013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1028/2020] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.321013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.331209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c712625-b489-4872-8dee-2f944682e552 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.336584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.337621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.337898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.338963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] PATH_INFO: `/v3/projects/591f49f5af87464ca487f56b5b620e2c/users/4568ab6f6ade48758fd450da4cd0a245/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.353871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591f49f5af87464ca487f56b5b620e2c, user_id=4568ab6f6ade48758fd450da4cd0a245, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.356454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.367392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 993/2021] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:45.368249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.378100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1029/2022] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:45 2022] PUT /identity/v3/projects/591f49f5af87464ca487f56b5b620e2c/users/4568ab6f6ade48758fd450da4cd0a245/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:45.378100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.379893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172a6e-a49c-4a28-9bd1-35ec593207da None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.389946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:45.448334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e045875-a2a8-4a99-9685-05c71ead91c7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.449078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.449891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.450176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.450453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.451136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.452758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.453124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.453732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.454015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.454283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.454939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.456900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.467822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 994/2023] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.467822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.475464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3386b5d-45ed-4df6-b858-958538917202 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.481160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.481799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.482101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.482374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.483605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.485244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.498112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1030/2024] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.502794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.503173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 995/2025] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.504040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.515288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709a06-ab1a-4838-9cdb-7a45bcb1d82a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.577505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.578150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.578426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.578720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.579398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.582666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.585121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aade3d-a878-4b73-b5a9-4dd68ee5c843 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.590524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.591269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.591555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.591832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] PATH_INFO: `/v3/projects/23ef6d9700e848f59dbd355d69aa3ae6/users/61a602c473684895a48fa4873554356f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.609737 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 996/2026] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:45.610696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.616883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ef6d9700e848f59dbd355d69aa3ae6, user_id=61a602c473684895a48fa4873554356f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.620242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.621558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c8d9-a20a-484a-9482-1dae84e01944 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.628472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.629227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.629521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.629791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] PATH_INFO: `/v3/projects/591f49f5af87464ca487f56b5b620e2c/users/4568ab6f6ade48758fd450da4cd0a245/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.632967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=591f49f5af87464ca487f56b5b620e2c, user_id=4568ab6f6ade48758fd450da4cd0a245, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.635766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45d45f-080b-4f31-9475-5063b412764e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.639744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1031/2027] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:45 2022] PUT /identity/v3/projects/23ef6d9700e848f59dbd355d69aa3ae6/users/61a602c473684895a48fa4873554356f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:45.642515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.656881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 997/2028] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:45 2022] PUT /identity/v3/projects/591f49f5af87464ca487f56b5b620e2c/users/4568ab6f6ade48758fd450da4cd0a245/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:45.656881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9c67-b1c9-451e-b071-e6b1db156624 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.656881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9c67-b1c9-451e-b071-e6b1db156624 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.656881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9c67-b1c9-451e-b071-e6b1db156624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.699614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:45.728044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-528d9c67-b1c9-451e-b071-e6b1db156624 None None] MFA Rules not processed for user `61a602c473684895a48fa4873554356f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:45.729449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-528d9c67-b1c9-451e-b071-e6b1db156624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:45.735221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b48cd-608d-4a4a-a473-5459880ee666 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:45.818115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:45.829431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 998/2029] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:45.829431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.829431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.829431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.851485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:45.852085 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:45.852675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:45.853003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:45.854696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:45.856542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:45.875608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1032/2030] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:45.876443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:45.878267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:45.895150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] MFA Rules not processed for user `4568ab6f6ade48758fd450da4cd0a245`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:45.896848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:45.998628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20899142-69fe-4da9-ac97-68b431f0faec admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.003192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.004050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.004340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.004613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.021220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.022944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.037160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1033/2031] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:46.038496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.062145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a268-b16d-456f-875f-d1d728e791a9 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.094149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.095136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.095634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.096111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.097096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.099460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.123081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1034/2032] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:46.127615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.136613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 999/2033] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:46.141455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35e73-af04-492d-b211-d004c43b4d9e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.149183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.149747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.150396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.150841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.151275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] PATH_INFO: `/v3/projects/e24e62481dce4823a9a457e50e4ed50f/users/cc303316d2d945d696dddc00716e09c9/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.153680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:46.180751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24e62481dce4823a9a457e50e4ed50f, user_id=cc303316d2d945d696dddc00716e09c9, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.183880 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9b548-1beb-450d-9829-4877cb842640 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.184370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1024585-bcd6-48aa-9bdf-48c2a9578078 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.189036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.189582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.189864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.190146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.204566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.205897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.207398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1035/2034] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:46 2022] PUT /identity/v3/projects/e24e62481dce4823a9a457e50e4ed50f/users/cc303316d2d945d696dddc00716e09c9/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:46.219027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.219841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.220196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.228427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1000/2035] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:46.254228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] MFA Rules not processed for user `cc303316d2d945d696dddc00716e09c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:46.255708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:46.275802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.291653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e1b01-4235-4ad9-bee0-8ec41f967699 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.318431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:46.371384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1036/2036] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:46.379486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.388674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.389453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.389733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.390015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.392837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:46.496672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.496672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.509473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1001/2037] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:46.607415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc72f1-2c20-4d2f-80dd-584b4f50327d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.629368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.629904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.630181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.630449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.631231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.633499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.681613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1037/2038] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:46 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:46.686666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.702760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dc773-f8fa-4447-ab02-e0621dc65ebf service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.726390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:46.780512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.781525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.782492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.782850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.784041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.786220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.813871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1002/2039] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:46 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:46.817825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.830377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71ad0-7b0a-40fd-967f-cbb48c922eab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.837020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.838311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.838602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.839143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.840151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.841847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.859567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1038/2040] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:46.860876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.873745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ad27-b70f-4e46-afa8-d7974c22611e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:46.878760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:46.879512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:46.879744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:46.880017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] PATH_INFO: `/v3/projects/7edf2869b9474a989b90ce692779a5e7/users/75f9edad1709469cab4b809eeb4c2372/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:46.900676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edf2869b9474a989b90ce692779a5e7, user_id=75f9edad1709469cab4b809eeb4c2372, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:46.904296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:46.919935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1003/2041] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:46 2022] PUT /identity/v3/projects/7edf2869b9474a989b90ce692779a5e7/users/75f9edad1709469cab4b809eeb4c2372/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:46.924281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:46.936774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222614b-8812-4e0c-9587-4c45f0146d7f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:47.031448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:47.032188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:47.032475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:47.032919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:47.033706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:47.035496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16040-8ec7-4c40-ae2f-3ae7cf65036a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:47.051146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1039/2042] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:47.054935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:47.069675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160897-caea-4da5-ad46-f4a814644fd9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:47.078921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:47.084487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:47.084487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:47.084487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] PATH_INFO: `/v3/projects/7edf2869b9474a989b90ce692779a5e7/users/75f9edad1709469cab4b809eeb4c2372/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:47.085959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edf2869b9474a989b90ce692779a5e7, user_id=75f9edad1709469cab4b809eeb4c2372, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:47.089787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:47.116347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1004/2043] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:47 2022] PUT /identity/v3/projects/7edf2869b9474a989b90ce692779a5e7/users/75f9edad1709469cab4b809eeb4c2372/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:47.126042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:47.126335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:47.126605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:47.161208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] MFA Rules not processed for user `75f9edad1709469cab4b809eeb4c2372`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:47.162533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:47.204226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:47.246704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1040/2044] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:47.259518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:47.338010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcddad6-9ea3-4031-913d-f49da65c5568 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:47.342610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:47.343492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:47.344087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:47.344571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:47.417606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:47.419220 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:47.432387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1005/2045] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:49.232104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:49.243118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd5ece-39de-410d-a2eb-9ebdc9fbdd26 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:49.249454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:49.250371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:49.250927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:49.254021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:49.360511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:49.362397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:49.377094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1041/2046] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:50.081519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:50.189027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:50.280633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aa7-f2ad-469e-89f9-c2648551ffb9 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:50.297506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:50.298184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:50.298489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:50.298919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] PATH_INFO: `/v3/users/d6aa4650790c41bab7e1f5a012562fda` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:50.300271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6aa4650790c41bab7e1f5a012562fda)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:50.302732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:50.455081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:50.460666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.486471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6aa4650790c41bab7e1f5a012562fda'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.490265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4c846-84eb-42fc-8c7f-9634b6d0b128 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:50.503336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6aa4650790c41bab7e1f5a012562fda'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.505136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6aa4650790c41bab7e1f5a012562fda'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.513003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:50.515167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:50.517238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:50.518559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] PATH_INFO: `/v3/users/364d2f6943f9434292bef4657a1d4f37` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:50.526040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364d2f6943f9434292bef4657a1d4f37)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:50.528783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:50.534631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6aa4650790c41bab7e1f5a012562fda'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.559184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6aa4650790c41bab7e1f5a012562fda'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.568200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1006/2047] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:50 2022] DELETE /identity/v3/users/d6aa4650790c41bab7e1f5a012562fda => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:50.572197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:50.576897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.635012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364d2f6943f9434292bef4657a1d4f37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.637513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364d2f6943f9434292bef4657a1d4f37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.671385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364d2f6943f9434292bef4657a1d4f37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.699402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364d2f6943f9434292bef4657a1d4f37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.700143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-80728a8f-4ab2-40eb-a5af-a850fcd27722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364d2f6943f9434292bef4657a1d4f37'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:50.718870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bfa6a-31c1-43ee-998f-662d31029c3a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:50.731082 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:50.731894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:50.732295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:50.733244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:50.736781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.745501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1042/2048] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:50 2022] DELETE /identity/v3/users/364d2f6943f9434292bef4657a1d4f37 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:50.745501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:50.745501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:50.745501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:50.774585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:50.775759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.836917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:50.874501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:50.877560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282decd-67a8-4cef-84f6-82d91453dfc1 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:50.889031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:50.905022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1007/2049] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:50.906993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1043/2050] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:50.909898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:50.910264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:50.917623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:50.921102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:50.922055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.960511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:50.961907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:50.979723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1008/2051] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:51.007444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:51.008904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:51.061126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61f66f-1e69-40f7-b959-68f4b6de7352 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:51.070448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:51.071095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:51.071378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:51.071669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:51.107073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:51.115191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:51.139558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89eb09-7adf-4f80-851e-15f14ec1e635 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:51.152380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:51.153401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1044/2052] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:51.157203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:51.158371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:51.159551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:51.195738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:51.197528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:51.231865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1009/2053] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:51.924125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:51.925728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:51.950748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281da24-7cba-40a7-9a64-c3e7b5e5679d service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:51.972494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:51.975446 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:51.981711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:51.982076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] PATH_INFO: `/v3/projects/d9cb1849f4ea444fb9b1e4ef8bac2567` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:51.987378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cb1849f4ea444fb9b1e4ef8bac2567)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:51.990783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:52.083647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cb1849f4ea444fb9b1e4ef8bac2567', 'request_id': 'req-3bc6bd73-cb50-40cb-8a26-f16d71779175'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.096518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cb1849f4ea444fb9b1e4ef8bac2567', 'request_id': 'req-3bc6bd73-cb50-40cb-8a26-f16d71779175'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.114839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cb1849f4ea444fb9b1e4ef8bac2567', 'request_id': 'req-3bc6bd73-cb50-40cb-8a26-f16d71779175'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.133269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] The token cache is being invalidate because project d9cb1849f4ea444fb9b1e4ef8bac2567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:52.133870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.135421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.139964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1045/2054] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:51 2022] DELETE /identity/v3/projects/d9cb1849f4ea444fb9b1e4ef8bac2567 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:52.144294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:52.155599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:52.159482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:52.162477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976d35-d4a7-4076-90f7-a529ed8812a7 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:52.291692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:52.293069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:52.293598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:52.294097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] PATH_INFO: `/v3/users/8b8fb06b8fc0487aa56e3cb14c4e5a4f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:52.295871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6bd73-cb50-40cb-8a26-f16d71779175 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:52.297454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8fb06b8fc0487aa56e3cb14c4e5a4f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:52.300033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:52.308341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:52.311667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:52.312103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:52.312396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] PATH_INFO: `/v3/projects/652abb9c45af4bcba8477b9aa20b0f48` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:52.316904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652abb9c45af4bcba8477b9aa20b0f48)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:52.323862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:52.349923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:52.397682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8fb06b8fc0487aa56e3cb14c4e5a4f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.406919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8fb06b8fc0487aa56e3cb14c4e5a4f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.419123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8fb06b8fc0487aa56e3cb14c4e5a4f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.431975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8fb06b8fc0487aa56e3cb14c4e5a4f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.436507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652abb9c45af4bcba8477b9aa20b0f48', 'request_id': 'req-78f2abf7-1a5e-49ee-9399-01f52183dc94'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.447977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652abb9c45af4bcba8477b9aa20b0f48', 'request_id': 'req-78f2abf7-1a5e-49ee-9399-01f52183dc94'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.456002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8fb06b8fc0487aa56e3cb14c4e5a4f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.458774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652abb9c45af4bcba8477b9aa20b0f48', 'request_id': 'req-78f2abf7-1a5e-49ee-9399-01f52183dc94'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.464745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1010/2055] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:52 2022] DELETE /identity/v3/users/8b8fb06b8fc0487aa56e3cb14c4e5a4f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:52.479935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] The token cache is being invalidate because project 652abb9c45af4bcba8477b9aa20b0f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:52.481940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.483593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.486892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1046/2056] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:52 2022] DELETE /identity/v3/projects/652abb9c45af4bcba8477b9aa20b0f48 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:52.490494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:52.493025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:52.518298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:52.589068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8560c87-6f63-47c8-9515-86e7b99fb79e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:52.599179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:52.599179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:52.599179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:52.599179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] PATH_INFO: `/v3/users/7ecac848dbfb47d6a5a26b0250f13bc1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:52.600150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecac848dbfb47d6a5a26b0250f13bc1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:52.602353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:52.722130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecac848dbfb47d6a5a26b0250f13bc1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.733355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecac848dbfb47d6a5a26b0250f13bc1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.734335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecac848dbfb47d6a5a26b0250f13bc1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.760945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecac848dbfb47d6a5a26b0250f13bc1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.789529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecac848dbfb47d6a5a26b0250f13bc1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:52.801143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1011/2057] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:52 2022] DELETE /identity/v3/users/7ecac848dbfb47d6a5a26b0250f13bc1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:52.874791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:52.876337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:52.969354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2abf7-1a5e-49ee-9399-01f52183dc94 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.059199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.059927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.060208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.061357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] PATH_INFO: `/v3/projects/dd89465b65d74dd19953dc9f8d3ddbc6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.062420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd89465b65d74dd19953dc9f8d3ddbc6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.064607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.136878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:53.139921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd89465b65d74dd19953dc9f8d3ddbc6', 'request_id': 'req-03dc0999-816c-4a0c-9ab8-7893cf90213c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.155998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.156528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd89465b65d74dd19953dc9f8d3ddbc6', 'request_id': 'req-03dc0999-816c-4a0c-9ab8-7893cf90213c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.157595 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.165568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd89465b65d74dd19953dc9f8d3ddbc6', 'request_id': 'req-03dc0999-816c-4a0c-9ab8-7893cf90213c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.180850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9e976-eaaa-46d9-b0a2-af3211a98298 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.201898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] The token cache is being invalidate because project dd89465b65d74dd19953dc9f8d3ddbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:53.202195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.202856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.207967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1047/2058] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:52 2022] DELETE /identity/v3/projects/dd89465b65d74dd19953dc9f8d3ddbc6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:53.208891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.210268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.258080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.258739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.259017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.259294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] PATH_INFO: `/v3/projects/c6f21100bb454fff954f3093273b3edc` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.260454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f21100bb454fff954f3093273b3edc)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.262396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.293279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0999-816c-4a0c-9ab8-7893cf90213c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.298350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.299002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.299283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.299567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] PATH_INFO: `/v3/users/4568ab6f6ade48758fd450da4cd0a245` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.300791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4568ab6f6ade48758fd450da4cd0a245)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.302737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.305989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:53.321359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f21100bb454fff954f3093273b3edc', 'request_id': 'req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.328575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f21100bb454fff954f3093273b3edc', 'request_id': 'req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.336251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f21100bb454fff954f3093273b3edc', 'request_id': 'req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.350875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] The token cache is being invalidate because project c6f21100bb454fff954f3093273b3edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:53.351177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.351846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1526c00b-f3cc-4e1c-b7eb-b61dcb91a936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.353489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1012/2059] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:53 2022] DELETE /identity/v3/projects/c6f21100bb454fff954f3093273b3edc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:53.357523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4568ab6f6ade48758fd450da4cd0a245'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.358255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4568ab6f6ade48758fd450da4cd0a245'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.358731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.359021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.359369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.371465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4568ab6f6ade48758fd450da4cd0a245'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.381335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4568ab6f6ade48758fd450da4cd0a245'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.382349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ff22b6ba-4f26-421f-9e4e-df1e969062cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4568ab6f6ade48758fd450da4cd0a245'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.385582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:53.387010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.400079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1048/2060] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:53 2022] DELETE /identity/v3/users/4568ab6f6ade48758fd450da4cd0a245 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:53.468299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1013/2061] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:53.475716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.476000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.476270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.501603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:53.503005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.556246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:53.576395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1049/2062] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:53.581095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.591511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ba87-516e-4bc2-9bf2-e08fbb6bb1a6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.598295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.599440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.599920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.600518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.601870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:53.602403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.604546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.620708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1014/2063] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:53.623787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.633997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee2bc0-732d-4e92-824f-8750f9ee41c5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.639853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.640621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.640930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.641222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.641887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.643847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.676145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1050/2064] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:53 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:53.680727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.695343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117f5a1-85d8-4b5d-aaf1-66224e7e18b0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.725999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.728147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.812046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.812845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.813142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.813526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.814399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.816555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.821545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e718-3bec-4bff-a8d2-980ec3c28758 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.826905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.827552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.828350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.828350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] PATH_INFO: `/v3/projects/591f49f5af87464ca487f56b5b620e2c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.830222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591f49f5af87464ca487f56b5b620e2c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.832435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.849115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1015/2065] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:53 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:53.850541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.861641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3e9b-1278-4211-a521-260622e92cfc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.868284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.869343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.869828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.870172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.871181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:53.872838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:53.888617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1016/2066] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:53.895779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:53.906600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12e741-8302-4fff-8634-040a19be7e10 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:53.915327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591f49f5af87464ca487f56b5b620e2c', 'request_id': 'req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.925403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591f49f5af87464ca487f56b5b620e2c', 'request_id': 'req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.931919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591f49f5af87464ca487f56b5b620e2c', 'request_id': 'req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.944206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:53.949833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] The token cache is being invalidate because project 591f49f5af87464ca487f56b5b620e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:53.950270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.950938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9a71cd6e-15a6-42a8-9c42-1dc8a49e5480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:53.953313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1051/2067] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:53 2022] DELETE /identity/v3/projects/591f49f5af87464ca487f56b5b620e2c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:53.958909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625429-8a6a-435d-a500-ec228d4bed4d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.959193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625429-8a6a-435d-a500-ec228d4bed4d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.959552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce625429-8a6a-435d-a500-ec228d4bed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.982112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce625429-8a6a-435d-a500-ec228d4bed4d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:53.983874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce625429-8a6a-435d-a500-ec228d4bed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:53.994124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:53.995074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:53.995074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:53.995293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:53.995986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.000885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.012146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1017/2068] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:54.017158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.019133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.032560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b816af-8252-45d4-9521-d35b1f3dc9c6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.037431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.038101 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.038382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.041190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] PATH_INFO: `/v3/projects/9c05c314670f4e6aa9da8abc4f78a635/users/1da9a6b8214d4cee91566163a1e5d1e5/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.056674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c05c314670f4e6aa9da8abc4f78a635, user_id=1da9a6b8214d4cee91566163a1e5d1e5, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.059444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c455d98-a67f-4ed4-9e7e-7c85e5783b1f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.067854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1052/2069] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:54.073967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1018/2070] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:54 2022] PUT /identity/v3/projects/9c05c314670f4e6aa9da8abc4f78a635/users/1da9a6b8214d4cee91566163a1e5d1e5/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:54.076100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45cea-436a-483c-a22b-6a166215804c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.076549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45cea-436a-483c-a22b-6a166215804c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.076854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45cea-436a-483c-a22b-6a166215804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.086896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.088726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.089115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:54.089795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.103691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-83c45cea-436a-483c-a22b-6a166215804c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:54.106082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-83c45cea-436a-483c-a22b-6a166215804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.137102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] MFA Rules not processed for user `1da9a6b8214d4cee91566163a1e5d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:54.138319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.204263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1053/2071] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:54.208443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c45cea-436a-483c-a22b-6a166215804c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.219079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c45cea-436a-483c-a22b-6a166215804c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.223190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1019/2072] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:54.224024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.226975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.227983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.227983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.228230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.229143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:54.229526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.244451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.244552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccb37b-db84-4b6a-b180-aea3b1c1a9e5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.244552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.244552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.244552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.244912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.244912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.245956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.257273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1054/2073] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:12:54.262487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.275318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad9818-9cb1-441d-b0a8-40add9585dc0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.280184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.280313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1020/2074] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:54.280876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.281160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.281265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.281411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.282118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.283210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.284234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.316129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1055/2075] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:54.316959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.353874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e8afd-4356-4bbd-8e96-bca75484a35e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.370759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:54.383807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06087ddd-329f-4a31-9d36-9303df72d4b9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.388922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.389527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.389798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.390096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.390751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.392705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.417888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1056/2076] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:54.417888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.425114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.425685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.426166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.426298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] PATH_INFO: `/v3/users/61a602c473684895a48fa4873554356f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.427336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f465e5-3574-4672-a1e2-83edd055dae3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.427455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a602c473684895a48fa4873554356f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.429612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.432487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.433209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.433483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.433754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.434412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.437022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.459210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1057/2077] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:54.460036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.470287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9fcf8-9d8e-43cd-af81-23fddc9b18ab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.475045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.475642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.475916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.476186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.476888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.478599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.485843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a602c473684895a48fa4873554356f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:54.493093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1058/2078] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:54.493093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.496026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a602c473684895a48fa4873554356f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:54.496777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a602c473684895a48fa4873554356f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:54.504065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3f56-01dd-4a22-94ce-a3c9885b2af3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.507570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a602c473684895a48fa4873554356f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:54.509067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.509941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.509941 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.510206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.510870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.512628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.523956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1059/2079] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:54.524681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.525829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a602c473684895a48fa4873554356f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:54.535583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1021/2080] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:54 2022] DELETE /identity/v3/users/61a602c473684895a48fa4873554356f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:54.543367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.543367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.543720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87155202-26e6-4c98-adbb-3e149fcbdbdf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.564334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:54.606842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.607607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.607943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.608215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] PATH_INFO: `/v3/projects/1a0e5a998330441198a1148e233935fa/users/43fca416a53440a7890c649e7ae99dae/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.611951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e51cea-85e7-44ed-9431-ad8ecbcfa2f4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.625176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.626160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.626160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.626610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.627243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.628672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e5a998330441198a1148e233935fa, user_id=43fca416a53440a7890c649e7ae99dae, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.628811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942f99f-e89e-4cf1-bdcc-e7b6af47b552 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.631246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.641917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1022/2081] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:54.643243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.643524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.643795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.650184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1060/2082] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:54 2022] PUT /identity/v3/projects/1a0e5a998330441198a1148e233935fa/users/43fca416a53440a7890c649e7ae99dae/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:54.650184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.664755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:54.665956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.702607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:54.733848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efd426-b785-4f46-a468-3d37626d5a93 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.738745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1023/2083] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:54.739023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.739960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.740126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.740234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.741223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] PATH_INFO: `/v3/projects/86f8e93897f54cf398c1234efdd1fa2c/users/74ed9818129642e9948bde474f0a4374/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.745848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.759651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd24f3-3d6d-42c3-a465-d50f64e76308 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.762018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f8e93897f54cf398c1234efdd1fa2c, user_id=74ed9818129642e9948bde474f0a4374, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.765199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.765333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.765832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.766114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.766389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.767088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.768692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.779345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1061/2084] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:54 2022] PUT /identity/v3/projects/86f8e93897f54cf398c1234efdd1fa2c/users/74ed9818129642e9948bde474f0a4374/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:54.779664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1024/2085] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:54.780812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.782469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.793451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:54.850076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958f69-b89b-4945-8dc6-976db52789ac admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.860154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6af163-c3e4-45da-bc28-73c906a2df97 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:54.864747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.865418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.865693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.865961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] PATH_INFO: `/v3/projects/1a0e5a998330441198a1148e233935fa/users/43fca416a53440a7890c649e7ae99dae/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.867900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e5a998330441198a1148e233935fa, user_id=43fca416a53440a7890c649e7ae99dae, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.870584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d708-4139-4964-91da-24492a378112 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.881955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1062/2086] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:54 2022] PUT /identity/v3/projects/1a0e5a998330441198a1148e233935fa/users/43fca416a53440a7890c649e7ae99dae/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:54.891771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.891771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.891771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.903501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:54.904130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.904447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.904764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.914631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:54.916081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce2369-9ed3-4b5e-bdea-cc70b336c75b service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:54.919181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] MFA Rules not processed for user `74ed9818129642e9948bde474f0a4374`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:54.920978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.929192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1025/2087] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:54.929435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:54.931672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:54.931984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:54.932392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:54.965796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] MFA Rules not processed for user `43fca416a53440a7890c649e7ae99dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:54.966962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:54.993728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1063/2088] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:54.999774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.059229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1026/2089] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:55.075944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.077596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.088485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54aeab-82fb-45cf-b4a5-cf24164af65d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.089645 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:55.102056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.103026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.103149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.103394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.104065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.106029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.147975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1064/2090] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:54 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:55.150808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.174593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373c17-e20f-4722-92fe-3f637ca18b66 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.240630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.241483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.241483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.242074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.274320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb3592-0596-4200-9e08-6ff4716b5722 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.285620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.287612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.289314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.289314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.289734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.293149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.328422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1065/2091] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:55 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:12:55.329460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.332372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.336585 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.339452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.346465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f76ba-37f7-4d62-b96f-c6665e6946cc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.352538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.353532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.354100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.354471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] PATH_INFO: `/v3/projects/23ef6d9700e848f59dbd355d69aa3ae6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.355419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1027/2092] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:55.356427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.363756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ef6d9700e848f59dbd355d69aa3ae6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.367781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.370676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480acc6-217b-4d2e-aabf-4aed8043ec5d service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.376755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.377736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.378330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.378991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.379918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.381936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.401281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1028/2093] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:55.407293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.426216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003406af-ae84-44d1-8c5b-38cb6b4662f9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.432794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.432996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:55.441152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.441551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.441923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] PATH_INFO: `/v3/projects/b349d2dcdf5c4700830073df552d511e/users/89171f2da46a47c795fa6b413a43244a/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.467321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b349d2dcdf5c4700830073df552d511e, user_id=89171f2da46a47c795fa6b413a43244a, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.486564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.488083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ef6d9700e848f59dbd355d69aa3ae6', 'request_id': 'req-e99ed4a3-08c0-401f-a630-0d11603d0584'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.499785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ef6d9700e848f59dbd355d69aa3ae6', 'request_id': 'req-e99ed4a3-08c0-401f-a630-0d11603d0584'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.513313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1029/2094] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:55 2022] PUT /identity/v3/projects/b349d2dcdf5c4700830073df552d511e/users/89171f2da46a47c795fa6b413a43244a/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:55.516202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ef6d9700e848f59dbd355d69aa3ae6', 'request_id': 'req-e99ed4a3-08c0-401f-a630-0d11603d0584'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.520787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.522750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.538871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] The token cache is being invalidate because project 23ef6d9700e848f59dbd355d69aa3ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:55.539928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.540825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.542810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1066/2095] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:55 2022] DELETE /identity/v3/projects/23ef6d9700e848f59dbd355d69aa3ae6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:55.543964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.546262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.584217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:55.627022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df6b11-051c-4bbf-8630-c906f1b70293 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.639497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.640296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.640578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.645037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] PATH_INFO: `/v3/users/0dde83e1287e4a0480a8e07d05367e30` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.649531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dde83e1287e4a0480a8e07d05367e30)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.652984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.663816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed4a3-08c0-401f-a630-0d11603d0584 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.672097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.673104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.673570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.674011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.675107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.677171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf9c0e-86fd-4cb2-9bb4-dbb06eeffd68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.698712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1067/2096] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:55.700189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.700475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.700773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.726386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:55.727678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.748992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1068/2097] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:55.753387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:55.766353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631712-f990-4f96-adde-9eb7d9b147cc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:55.772334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:55.772763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dde83e1287e4a0480a8e07d05367e30'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.773197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.773437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.773705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] PATH_INFO: `/v3/projects/b349d2dcdf5c4700830073df552d511e/users/89171f2da46a47c795fa6b413a43244a/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.775949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b349d2dcdf5c4700830073df552d511e, user_id=89171f2da46a47c795fa6b413a43244a, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:55.778784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342d9b-c4d4-4021-ba07-fe2db521710b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:55.782527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dde83e1287e4a0480a8e07d05367e30'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.783479 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dde83e1287e4a0480a8e07d05367e30'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.793055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dde83e1287e4a0480a8e07d05367e30'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.797091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1069/2098] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:55 2022] PUT /identity/v3/projects/b349d2dcdf5c4700830073df552d511e/users/89171f2da46a47c795fa6b413a43244a/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:55.799321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2043f-bcf3-4d02-8fb2-3399034a088b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.799925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2043f-bcf3-4d02-8fb2-3399034a088b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.800702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2043f-bcf3-4d02-8fb2-3399034a088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.833518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5ca2043f-bcf3-4d02-8fb2-3399034a088b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:55.834214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ca2043f-bcf3-4d02-8fb2-3399034a088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.835663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd102c7-6186-45b3-b396-ac5bdbe29fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dde83e1287e4a0480a8e07d05367e30'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:55.857003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1030/2099] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:55 2022] DELETE /identity/v3/users/0dde83e1287e4a0480a8e07d05367e30 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:55.857003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.857003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.857003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.930116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] MFA Rules not processed for user `89171f2da46a47c795fa6b413a43244a`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:55.931323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.936827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1070/2100] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:55.937868 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:55.938268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:55.938626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:55.963692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:55.964962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:55.989576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:56.028071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1031/2101] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:56.028987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.058023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1071/2102] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:56.062164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.062164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.089589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:56.112296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776fdd-44b2-42bf-bdc0-005ae6dbcc5f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.118416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.119056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.119342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.119618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.120330 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:56.120672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.122298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.135871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64597871-9c2a-457e-8ea2-618ddc575071 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.137031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1032/2103] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:56.138186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.142075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.144754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.146023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.146544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.146885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.149562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.210239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786fa40-8a64-49eb-a478-edd88f9ff9e9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.214678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.215305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.215583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.215857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.220535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.222001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.225375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.226784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.231375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1072/2104] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:56.232435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.237984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1033/2105] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:56.239012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.240634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.244230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331509d8-bd28-4ff8-92b0-3a4b8c58ab11 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.250190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.250958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.251301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.251643 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.252410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.254416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.258710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43686f50-1c2c-48e9-92f1-e5491742aa0c service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.264772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.265658 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.266008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.266360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] PATH_INFO: `/v3/users/1da9a6b8214d4cee91566163a1e5d1e5` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.267668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da9a6b8214d4cee91566163a1e5d1e5)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.270327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.296668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1073/2106] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:56 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:56.300788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.365688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da9a6b8214d4cee91566163a1e5d1e5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.376975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da9a6b8214d4cee91566163a1e5d1e5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.377839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da9a6b8214d4cee91566163a1e5d1e5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.392255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da9a6b8214d4cee91566163a1e5d1e5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.397649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:56.402870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a183-3719-4f25-94d2-3cd9e8a6b68f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.412179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.413136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.413768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.414213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.414992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.417796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.419301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1fab4314-0188-4a51-8bdf-902440576595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da9a6b8214d4cee91566163a1e5d1e5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.432787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1034/2107] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:56 2022] DELETE /identity/v3/users/1da9a6b8214d4cee91566163a1e5d1e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:56.434889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.435183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.436022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.467181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1074/2108] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:56 2022] POST /identity/v3/users => generated 281 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:56.471494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.474008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.475401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:56.477505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.496741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb26455-ece5-412c-a3e7-0981f7df4ef1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.543905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:56.572152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1035/2109] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:56.591743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.593431 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.598101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.599710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.599938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.600227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.601081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.603616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.618552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1075/2110] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:56.618552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.620678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.659972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ff392-07b7-4626-a716-0289ccf343b3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.673739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.674702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.674998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.675273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] PATH_INFO: `/v3/projects/cebff159906e4ac1bc913d51315874ae` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.677022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebff159906e4ac1bc913d51315874ae)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.679062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.724038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464374-dd6b-43ed-9398-e3cfdeb94427 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.728789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.729944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.730361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.730784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.749056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.750729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.778757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1036/2111] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:12:56.778757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.787954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8f4c-9855-430f-9751-75d426cdb16d service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.805942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebff159906e4ac1bc913d51315874ae', 'request_id': 'req-9b110580-ebea-49f3-a034-1a35a4212b70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.816331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebff159906e4ac1bc913d51315874ae', 'request_id': 'req-9b110580-ebea-49f3-a034-1a35a4212b70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.830015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebff159906e4ac1bc913d51315874ae', 'request_id': 'req-9b110580-ebea-49f3-a034-1a35a4212b70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.851792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] The token cache is being invalidate because project cebff159906e4ac1bc913d51315874ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:56.852084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.852925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.858025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1076/2112] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:56 2022] DELETE /identity/v3/projects/cebff159906e4ac1bc913d51315874ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:56.860561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.862299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.867467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.868041 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.868343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.868602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.869769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.871640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.885353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110580-ebea-49f3-a034-1a35a4212b70 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.885828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1037/2113] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:56.890567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:56.893677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:56.894497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.895269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.895615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.896377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] PATH_INFO: `/v3/users/cc303316d2d945d696dddc00716e09c9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.897236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc303316d2d945d696dddc00716e09c9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.899316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.907689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e7793-22fd-4677-9da7-5856eeb7f524 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:56.913494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:56.914223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.914501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.914917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] PATH_INFO: `/v3/projects/c82f3de1a6c043c1a6fd5ae36476126c/users/a88698aaceb343338d33e4decf092b43/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.930385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f3de1a6c043c1a6fd5ae36476126c, user_id=a88698aaceb343338d33e4decf092b43, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:56.933302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1012e-1395-4cf9-a156-8a1b1db160bc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:56.950473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1038/2114] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:56 2022] PUT /identity/v3/projects/c82f3de1a6c043c1a6fd5ae36476126c/users/a88698aaceb343338d33e4decf092b43/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:56.961481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:56.961777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:56.962054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:56.967068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc303316d2d945d696dddc00716e09c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.968264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc303316d2d945d696dddc00716e09c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:56.984329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:56.987417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc303316d2d945d696dddc00716e09c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.000001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc303316d2d945d696dddc00716e09c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.001185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc303316d2d945d696dddc00716e09c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.010930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] MFA Rules not processed for user `a88698aaceb343338d33e4decf092b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:57.012145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.020717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1077/2115] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:56 2022] DELETE /identity/v3/users/cc303316d2d945d696dddc00716e09c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:57.092700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:57.109846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1039/2116] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:57.148807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.150844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.238216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.239823 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.262130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc261d-16da-4bc7-947c-f14c8763bc5c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.270617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:57.271396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.272951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.273248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.336196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cfc8a-4e03-45b2-a5bc-519c0f4ef511 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.358564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:57.360380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:57.374187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1078/2117] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:57.378009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.389143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.409924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:57.410759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.411105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.411450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] PATH_INFO: `/v3/projects/9c05c314670f4e6aa9da8abc4f78a635` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.412723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c05c314670f4e6aa9da8abc4f78a635)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:57.414716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:57.465809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e0b7-d21b-4110-b430-16fa8acb4c3d service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.473521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c05c314670f4e6aa9da8abc4f78a635', 'request_id': 'req-932d3925-617d-447d-8aa6-cdc1691d5160'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.480300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c05c314670f4e6aa9da8abc4f78a635', 'request_id': 'req-932d3925-617d-447d-8aa6-cdc1691d5160'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.489043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c05c314670f4e6aa9da8abc4f78a635', 'request_id': 'req-932d3925-617d-447d-8aa6-cdc1691d5160'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.502518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] The token cache is being invalidate because project 9c05c314670f4e6aa9da8abc4f78a635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:57.502830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.503696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.505250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1040/2118] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:57 2022] DELETE /identity/v3/projects/9c05c314670f4e6aa9da8abc4f78a635 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:57.506079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.507394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.508225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:57.536095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:57.536791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.537072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.537344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] PATH_INFO: `/v3/projects/e24e62481dce4823a9a457e50e4ed50f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.538593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24e62481dce4823a9a457e50e4ed50f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:57.540541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:57.554472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:57.587999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d3925-617d-447d-8aa6-cdc1691d5160 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.594506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24e62481dce4823a9a457e50e4ed50f', 'request_id': 'req-6adca8c2-1561-410e-8ddf-db87fef565d5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.606566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24e62481dce4823a9a457e50e4ed50f', 'request_id': 'req-6adca8c2-1561-410e-8ddf-db87fef565d5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.613566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24e62481dce4823a9a457e50e4ed50f', 'request_id': 'req-6adca8c2-1561-410e-8ddf-db87fef565d5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.627098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] The token cache is being invalidate because project e24e62481dce4823a9a457e50e4ed50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:57.627406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.628032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.629672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1079/2119] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:57 2022] DELETE /identity/v3/projects/e24e62481dce4823a9a457e50e4ed50f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:57.630664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.632139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.653838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:57.655143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.655545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.655908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] PATH_INFO: `/v3/users/a88698aaceb343338d33e4decf092b43` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.657245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88698aaceb343338d33e4decf092b43)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:57.659268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:57.702391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adca8c2-1561-410e-8ddf-db87fef565d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.707555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:57.708208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.708503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.708801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] PATH_INFO: `/v3/users/43fca416a53440a7890c649e7ae99dae` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.709993 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fca416a53440a7890c649e7ae99dae)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:57.710973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88698aaceb343338d33e4decf092b43'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.711923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:57.722268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88698aaceb343338d33e4decf092b43'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.723275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88698aaceb343338d33e4decf092b43'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.733146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88698aaceb343338d33e4decf092b43'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.756847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88698aaceb343338d33e4decf092b43'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.771219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1041/2120] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:57 2022] DELETE /identity/v3/users/a88698aaceb343338d33e4decf092b43 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:57.772969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:57.775229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.796298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fca416a53440a7890c649e7ae99dae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.804353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fca416a53440a7890c649e7ae99dae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.824846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fca416a53440a7890c649e7ae99dae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.833504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fca416a53440a7890c649e7ae99dae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.834164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cdbaa9c8-336f-4b74-8cf5-6a2226ba1275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fca416a53440a7890c649e7ae99dae'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:57.835747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:57.864503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1080/2121] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:57 2022] DELETE /identity/v3/users/43fca416a53440a7890c649e7ae99dae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:57.866259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:57.866803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:57.867838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:57.891840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b78a7-a870-4655-af56-eddc70fcb0c9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:57.900493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:57.911364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:57.912667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:57.995597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1081/2122] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:58.003820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:58.005478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.010628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:58.017974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.018622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.019294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] PATH_INFO: `/v3/users/75f9edad1709469cab4b809eeb4c2372` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.021342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f9edad1709469cab4b809eeb4c2372)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:58.025165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:58.110191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941ce84-a03b-4330-85ec-4d950708d26f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:58.115852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:58.116582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.116995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.117368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.130287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:58.131826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:58.137681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f9edad1709469cab4b809eeb4c2372'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.146634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1082/2123] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:12:58.147252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f9edad1709469cab4b809eeb4c2372'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.148012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f9edad1709469cab4b809eeb4c2372'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.159129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f9edad1709469cab4b809eeb4c2372'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.185980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f9edad1709469cab4b809eeb4c2372'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.197156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1042/2124] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:12:57 2022] DELETE /identity/v3/users/75f9edad1709469cab4b809eeb4c2372 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:58.589635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:58.591919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.606847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3edfd-ecda-400c-9c2b-d9a037692987 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:58.684341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:58.687066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.687066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.687255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] PATH_INFO: `/v3/projects/1a0e5a998330441198a1148e233935fa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.688425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0e5a998330441198a1148e233935fa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:58.690373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:58.746599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:58.753040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:58.754978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.772193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0e5a998330441198a1148e233935fa', 'request_id': 'req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.772416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701b8fb-5cfd-4802-9724-0cd76fa9ebbf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:58.780267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0e5a998330441198a1148e233935fa', 'request_id': 'req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.790878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0e5a998330441198a1148e233935fa', 'request_id': 'req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.820091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] The token cache is being invalidate because project 1a0e5a998330441198a1148e233935fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:58.820091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.820627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5e06c92c-4f0f-442f-b7ae-40cf0fd2e139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.824942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1083/2125] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:58 2022] DELETE /identity/v3/projects/1a0e5a998330441198a1148e233935fa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:58.831273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0358de-ccd4-47ab-aed1-e0af6bf66d0d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.831626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0358de-ccd4-47ab-aed1-e0af6bf66d0d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.831965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0358de-ccd4-47ab-aed1-e0af6bf66d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.859546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e0358de-ccd4-47ab-aed1-e0af6bf66d0d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:58.861455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e0358de-ccd4-47ab-aed1-e0af6bf66d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.863766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:58.865453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.865968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.866319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] PATH_INFO: `/v3/projects/c82f3de1a6c043c1a6fd5ae36476126c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.867822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82f3de1a6c043c1a6fd5ae36476126c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:58.870122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:58.872956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1084/2126] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:58.884894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:58.884894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:58.884894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:58.925535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:58.927036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.940043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:58.945381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1085/2127] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:12:58.946441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:58.948508 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:58.963603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbd9a4-23a6-4497-a74b-c408535ef268 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:58.979171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82f3de1a6c043c1a6fd5ae36476126c', 'request_id': 'req-712b5a10-6346-44f3-936d-608a6480236e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.987671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82f3de1a6c043c1a6fd5ae36476126c', 'request_id': 'req-712b5a10-6346-44f3-936d-608a6480236e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:58.994066 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82f3de1a6c043c1a6fd5ae36476126c', 'request_id': 'req-712b5a10-6346-44f3-936d-608a6480236e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.010528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] The token cache is being invalidate because project c82f3de1a6c043c1a6fd5ae36476126c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:59.010818 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.011830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.014393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1043/2128] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:58 2022] DELETE /identity/v3/projects/c82f3de1a6c043c1a6fd5ae36476126c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:12:59.015559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.017273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.044596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.046103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.046447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.046867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] PATH_INFO: `/v3/projects/7edf2869b9474a989b90ce692779a5e7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.048130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7edf2869b9474a989b90ce692779a5e7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.050145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.102892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b5a10-6346-44f3-936d-608a6480236e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.110428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.111155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.111490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.111847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.112557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:59.112990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.117226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d23f3d-50f5-4c05-a469-6dfed16f587c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.128365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edf2869b9474a989b90ce692779a5e7', 'request_id': 'req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.131412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1044/2129] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:59.132773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731abe-306d-48f6-9a6e-a01fa31e16dc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.133060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731abe-306d-48f6-9a6e-a01fa31e16dc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.133356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731abe-306d-48f6-9a6e-a01fa31e16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.136441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edf2869b9474a989b90ce692779a5e7', 'request_id': 'req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.143784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edf2869b9474a989b90ce692779a5e7', 'request_id': 'req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.155768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-00731abe-306d-48f6-9a6e-a01fa31e16dc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:59.157331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-00731abe-306d-48f6-9a6e-a01fa31e16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.159194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] The token cache is being invalidate because project 7edf2869b9474a989b90ce692779a5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:12:59.159586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.160421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:12:59.166140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1086/2130] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:12:58 2022] DELETE /identity/v3/projects/7edf2869b9474a989b90ce692779a5e7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:59.166140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.166140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.220504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:59.243659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229642-2caf-4fea-a2b3-d5eb3b4ff8b0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.243838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1045/2131] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:59.245021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6a9a-121d-4181-b609-73ea8e608edd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.245255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6a9a-121d-4181-b609-73ea8e608edd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.245528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d6a9a-121d-4181-b609-73ea8e608edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.254633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.255342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.255617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.255899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.256562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.258766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c478d-2494-448a-9529-cd45ce543ebb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.267774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-fd0d6a9a-121d-4181-b609-73ea8e608edd None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:59.269015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fd0d6a9a-121d-4181-b609-73ea8e608edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.284799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1046/2132] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:59.286393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.287983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.288286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.292923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1087/2133] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.294799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.295746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.296028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.312869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:59.314789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.317412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:12:59.318590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:12:59.365765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:59.391139 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1047/2134] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:59.394583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.397416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1088/2135] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:12:59.399744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.409537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d82ef-a92b-4215-97ca-ee44fdee77b6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.414175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd5e91-4631-48b8-abfc-6bcec674688b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.416178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.416961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.417247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.417517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.418630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.419802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.421026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.421318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.421424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.421718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.422475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:59.422846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.424465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.443742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1089/2136] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:59.443742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.447862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1048/2137] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.448898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.455514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610d0-940e-4345-88b8-9bbf6cb919e2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.460524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.461184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.461468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.461741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.462727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:12:59.463049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.464792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.465210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af987c-46cb-4367-8a86-30708e5b3bb5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.472909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.473775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.474367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.474867 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.475896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.481708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.483168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1090/2138] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:12:59.484700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.496325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88584-302d-40d2-9529-a969c37dc33a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.502184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.502813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.503095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.503371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.504089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.505740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.521404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1091/2139] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:59.522251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.532235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1049/2140] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.533575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34650b83-cdc3-4f0e-8ecf-831b517bb427 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.536532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.601043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.601687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.601960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.602233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.602992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.605209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.628790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254548-177a-4110-82ca-1d6694265fb2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.633796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.634712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.635094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.635812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.636563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.639298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.652061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1050/2141] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:59.653064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.661053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1092/2142] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.661928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.668064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1327-e91d-4452-a11d-f691efc4fe53 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.687250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:59.755091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4dee-afdf-4d8b-bd65-d0fe191369e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.760356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.761298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.761538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.761784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] PATH_INFO: `/v3/projects/2b1d272c58b443388f0147586600b555/users/742ae4aafa454b549682ceb88beb552f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.762137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.762933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.763186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.763380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.764575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.767757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.780844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1d272c58b443388f0147586600b555, user_id=742ae4aafa454b549682ceb88beb552f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.784105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.795576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1051/2143] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.796886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.808002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3808f-df4a-49ff-9fd1-aa302a97b8f3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.809189 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1093/2144] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:12:59 2022] PUT /identity/v3/projects/2b1d272c58b443388f0147586600b555/users/742ae4aafa454b549682ceb88beb552f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:12:59.810214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:12:59.848384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:12:59.891441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.892445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.893107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.893424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.894251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.896333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf13d3-53b5-4ee0-8800-97ff11d82ea3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.929439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1052/2145] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:12:59.930754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.931044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.931322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.937059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc100272-cb6b-4563-b8b0-3eb6ece9e06b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:12:59.949197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:12:59.949839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:12:59.950164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:12:59.950390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:12:59.951856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:12:59.955464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:12:59.983477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1094/2146] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:12:59.983477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.006638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83318c6d-d8e8-4bfb-9268-8fcc9c9c6fd0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.009638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] MFA Rules not processed for user `742ae4aafa454b549682ceb88beb552f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:00.011135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.012837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.014252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.014850 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.015304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.016204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.017844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.033724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1095/2147] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:00.034848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.057638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c339edf-953b-4da5-ad1f-17f71436621e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.064792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.065766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.066394 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.066865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.068250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.070412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.086142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1096/2148] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:00.087157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.102029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af70-2369-4e8c-8551-d4299cc46315 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.107728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.108998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.109285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.109558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.110692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.112546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.128612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1097/2149] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:00.128612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.129661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1053/2150] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:12:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:00.130620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.140274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228ebcb-d7b9-4220-9d28-0402273034d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.146257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.146514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.146799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.147135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] PATH_INFO: `/v3/projects/cb6a49d333e5430d8b58fafb7fe7dfb4/users/327e18878b8f4b83854bc9652ea4a41f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.153216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a35e-ae53-467c-8d40-0ba5e7b89efc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.158076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.158822 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.159102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.159465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] PATH_INFO: `/v3/projects/c43f5e34819c4cd592c3dcf94ff90283/users/a36b47557ab74117bfce42df9acf2677/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.163915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6a49d333e5430d8b58fafb7fe7dfb4, user_id=327e18878b8f4b83854bc9652ea4a41f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.166607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.179229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43f5e34819c4cd592c3dcf94ff90283, user_id=a36b47557ab74117bfce42df9acf2677, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.182216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5297ea0-2af9-4294-aeda-81c105b1c410 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.183780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1098/2151] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:00 2022] PUT /identity/v3/projects/cb6a49d333e5430d8b58fafb7fe7dfb4/users/327e18878b8f4b83854bc9652ea4a41f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:00.184473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.186679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.201987 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1054/2152] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:00 2022] PUT /identity/v3/projects/c43f5e34819c4cd592c3dcf94ff90283/users/a36b47557ab74117bfce42df9acf2677/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:00.203534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e2507-cc31-40b9-8571-7ce60deb85c4 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.204164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e2507-cc31-40b9-8571-7ce60deb85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.204164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e2507-cc31-40b9-8571-7ce60deb85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.233439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:00.238153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-919e2507-cc31-40b9-8571-7ce60deb85c4 None None] MFA Rules not processed for user `327e18878b8f4b83854bc9652ea4a41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:00.239443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-919e2507-cc31-40b9-8571-7ce60deb85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.252597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4b8f-4092-44a3-b890-87a63c85d41b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.302475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.303261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.303522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.304137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.314604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1055/2153] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:00.314604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.314604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.314604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.344584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] MFA Rules not processed for user `a36b47557ab74117bfce42df9acf2677`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:00.346206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.350354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:00.374475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.375927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.385668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1099/2154] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:00.386523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.432852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1056/2155] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:00.433991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.472594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78317-065e-4c28-a7c9-0dfe201a6033 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.477323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.477944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.478229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.478500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.479279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.481236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.507303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c795-b5ea-448a-b86f-c5be9abf2817 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.514090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1100/2156] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:00.514090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.514363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.514363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.514363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.514363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] PATH_INFO: `/v3/users/742ae4aafa454b549682ceb88beb552f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.515043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742ae4aafa454b549682ceb88beb552f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.516269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.517010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.558042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:00.566372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742ae4aafa454b549682ceb88beb552f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:00.573596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742ae4aafa454b549682ceb88beb552f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:00.574287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742ae4aafa454b549682ceb88beb552f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:00.582003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742ae4aafa454b549682ceb88beb552f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:00.582433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2ecf-4f5d-415b-80aa-5aae4af88eff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.586128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.586736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.587010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.587646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.596051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742ae4aafa454b549682ceb88beb552f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:00.602361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1057/2157] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:00 2022] DELETE /identity/v3/users/742ae4aafa454b549682ceb88beb552f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:00.603127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.604438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.632933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:00.646659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.648076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d9c9f-d6dd-4dc9-a970-0172fe63a926 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.657630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1101/2158] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:00.658851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.659137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.659411 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.674834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4659-37cf-48ef-822b-a9caf1a7d835 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.680964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:00.682183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.683193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.683826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.684380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.684700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.685408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.687481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.693731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1102/2159] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:00.700709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.702596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:00.712811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1058/2160] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:00.717793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.731158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab920ff-d589-4c5f-a604-e7eb621653cd admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.742231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.743224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.743721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.744364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.745626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.748293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.767935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1059/2161] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:00.769715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.782156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d89e0-05a9-4716-96e2-3c58d5655b34 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.782897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53b28-3353-4f8c-9c80-2b86d8cad81b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.788266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.788440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.789043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.789265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.789378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.789679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.789805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.790517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.791437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.793162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.803905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.808792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1060/2162] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:00.808929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f2f7-0f84-4346-a994-b6cbd5c53063 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.810365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:00.818405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1103/2163] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:00.827432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793d1d-11f8-4ea9-a842-1c0463dab043 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:00.833276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:00.834034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.834497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.834899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] PATH_INFO: `/v3/projects/e20e4ba0511b43fa8cb9cc4d129d3d55/users/df67ffb6047a44c1846f464219155ea1/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.853657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20e4ba0511b43fa8cb9cc4d129d3d55, user_id=df67ffb6047a44c1846f464219155ea1, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:00.855285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:00.885696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1061/2164] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:00 2022] PUT /identity/v3/projects/e20e4ba0511b43fa8cb9cc4d129d3d55/users/df67ffb6047a44c1846f464219155ea1/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:00.888038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:00.888512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:00.888969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:00.927807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] MFA Rules not processed for user `df67ffb6047a44c1846f464219155ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:00.929240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.024110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1104/2165] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:01.030091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.126372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0df58-6045-4151-9f4c-92b24dc5ec5b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.136047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.136720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.137011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.137284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.138005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.140577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.183487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1062/2166] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:01.187873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.202840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.204900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.207410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e7131-3930-45c6-941a-effcfa659408 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.218738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:01.300725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.301571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.301843 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.302116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.302792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.317147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.333454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:01.345589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb25e-5f2e-4855-af58-154de0833879 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.349686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1105/2167] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:01.350770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.352558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.356001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.357042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.358879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.359370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] PATH_INFO: `/v3/projects/2b1d272c58b443388f0147586600b555` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.369900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1d272c58b443388f0147586600b555)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.371929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.445594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1d272c58b443388f0147586600b555', 'request_id': 'req-b7c199fb-aacd-459c-a80b-7c313675dc2b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:01.452368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c016d-24f0-41d3-9f57-3e6a64f41064 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.453617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1d272c58b443388f0147586600b555', 'request_id': 'req-b7c199fb-aacd-459c-a80b-7c313675dc2b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:01.460012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1d272c58b443388f0147586600b555', 'request_id': 'req-b7c199fb-aacd-459c-a80b-7c313675dc2b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:01.473923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] The token cache is being invalidate because project 2b1d272c58b443388f0147586600b555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:01.474213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:01.474848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:01.476371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1063/2168] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:01 2022] DELETE /identity/v3/projects/2b1d272c58b443388f0147586600b555 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:01.480423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.481908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.508999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.509873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.510155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.510427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.512196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.550115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c199fb-aacd-459c-a80b-7c313675dc2b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.555053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.555773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.556048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.556323 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.557070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.558661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e73b-4d46-44e8-8663-a950f417a65c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.568621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1064/2169] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:01.570013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d576-9e19-480c-ad81-fe404ee9893f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.570299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d576-9e19-480c-ad81-fe404ee9893f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.570567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d576-9e19-480c-ad81-fe404ee9893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.576123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.577878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.588080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1106/2170] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:01.588891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.591306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f307d576-9e19-480c-ad81-fe404ee9893f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:01.593207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f307d576-9e19-480c-ad81-fe404ee9893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.600013 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507477e-a096-49c6-a6be-51379c64633b service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.602576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1065/2171] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:01.604936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.605769 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.606199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.606628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] PATH_INFO: `/v3/projects/366cf72773234731aceb86423aa24096/users/adf5963d68854c7d8f707d3dc32b32d8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.609766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:01.611333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.611333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.611333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.627027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=366cf72773234731aceb86423aa24096, user_id=adf5963d68854c7d8f707d3dc32b32d8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.629736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.631738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:01.633578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.641494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1066/2172] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:01.647310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.647735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1107/2173] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:01 2022] PUT /identity/v3/projects/366cf72773234731aceb86423aa24096/users/adf5963d68854c7d8f707d3dc32b32d8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:01.651340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.657020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f0140-07ae-489a-9ed7-016592094f4e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.725592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.726229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.726487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23ba1-511a-45ec-91fa-37efc550eb2e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.726598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.726770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.727523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:01.727770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.729555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.731668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.732319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.732596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.732895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.733586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.735300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.740204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:01.750062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1108/2174] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:01.750990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1067/2175] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:13:01.752853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.753224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.765452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560ca3-8230-49de-be96-ca4bc353b911 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.770624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.771287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.771613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.771887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] PATH_INFO: `/v3/projects/366cf72773234731aceb86423aa24096/users/adf5963d68854c7d8f707d3dc32b32d8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.772541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261e7f-6952-409c-b85e-5dce11900d7a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.774218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=366cf72773234731aceb86423aa24096, user_id=adf5963d68854c7d8f707d3dc32b32d8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.777201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb52f1-12e6-40e5-b18f-81f4e79ac8bf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.790770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.791560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.791850 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.792128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.792899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.795160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.800448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1109/2176] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:01 2022] PUT /identity/v3/projects/366cf72773234731aceb86423aa24096/users/adf5963d68854c7d8f707d3dc32b32d8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:01.812223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.812905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.813754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.837918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1068/2177] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:01.838604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:01.877564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] MFA Rules not processed for user `adf5963d68854c7d8f707d3dc32b32d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:01.878886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:01.956672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1287c4-ec66-4e12-89e9-d5f42f78b2a5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:01.963777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:01.964542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:01.964972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:01.965417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:01.966349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:01.969711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:01.994211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1110/2178] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:02.001959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:02.003065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1069/2179] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:01 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:02.007201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:02.007333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:02.021853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10389257-8ee3-4ff4-8acb-63fe90f065c5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:02.028244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:02.028909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.029947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.030228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.030932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:02.032696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:02.043320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1070/2180] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:02.047351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:02.056751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd275aec-ef28-4204-8735-3c7cfa6eba2e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:02.063040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:02.064004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.064293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.064569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.065603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:02.067639 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:02.072153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2456b4-c629-48e2-865c-16c3699a3708 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:02.079020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:02.080748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.080864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1071/2181] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:02.080955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.083525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.085036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:02.085147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:02.091246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:02.096727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c26c67-ffc2-4665-b144-450457ac708c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:02.102095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:02.102772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.103050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.103356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] PATH_INFO: `/v3/projects/d610b083631b4783b9e6a1fb7386048d/users/57718594421249669c863c1f8d97830f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.120110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d610b083631b4783b9e6a1fb7386048d, user_id=57718594421249669c863c1f8d97830f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:02.123542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878e982-6f1c-4fea-b076-5758c98ea8f1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:02.143263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1072/2182] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:02 2022] PUT /identity/v3/projects/d610b083631b4783b9e6a1fb7386048d/users/57718594421249669c863c1f8d97830f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:02.145911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0bf0-0115-4d1d-8a75-c19b96f24391 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.146187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0bf0-0115-4d1d-8a75-c19b96f24391 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.146512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb0bf0-0115-4d1d-8a75-c19b96f24391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.160168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:02.162535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:02.167153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-72eb0bf0-0115-4d1d-8a75-c19b96f24391 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:02.168371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-72eb0bf0-0115-4d1d-8a75-c19b96f24391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:02.174579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1111/2183] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:02.234201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1073/2184] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:02.254447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:02.258725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:02.320949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3b5d-1d3c-41d1-a2d2-79f3d9c3044c service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:02.371900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:02.372511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:02.375206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:02.375206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:02.384162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:02.385623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:02.402392 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1112/2185] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:03.142393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:03.142962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:03.142962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:03.171905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] MFA Rules not processed for user `57718594421249669c863c1f8d97830f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:03.173176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:03.189769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:03.273487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1074/2186] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:03.284760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:03.286174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:03.354739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2259397-229e-49ea-a1a9-beeaa4b2634d service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:03.363268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:03.364090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:03.364201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:03.364462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:03.374254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:03.375692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140aa3a-b9fa-45db-9e6c-c75dc7f81c8c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:03.384695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1113/2187] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:03.856899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:03.867882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e1dd-d4c0-422b-9486-d0080f183c92 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:03.871966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:03.872736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:03.873006 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:03.873275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:03.875150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:03.959649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:03.961181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:03.974902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1075/2188] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:04.822727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:04.823246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:04.823340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:04.854404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:04.863182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] MFA Rules not processed for user `57718594421249669c863c1f8d97830f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:04.864657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:04.890594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1114/2189] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:04.955672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:04.965640 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec106-19d7-4d44-96cd-7c3c261fb480 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:04.971290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:04.973339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:04.973728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:04.974106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:05.077820 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:05.086452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:05.108521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1076/2190] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:06.641065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:06.642609 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:06.680337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac07f9-5cff-4057-8fe7-f478ad59eb3b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:06.692282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:06.693444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:06.693885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:06.694355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] PATH_INFO: `/v3/users/4f68657a55414ec39a27136701c41936` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:06.695939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f68657a55414ec39a27136701c41936)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:06.698379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:06.795040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f68657a55414ec39a27136701c41936'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:06.796169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f68657a55414ec39a27136701c41936'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:06.832550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f68657a55414ec39a27136701c41936'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:06.849040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f68657a55414ec39a27136701c41936'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:06.849668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f68657a55414ec39a27136701c41936'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:06.863248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1115/2191] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:06 2022] DELETE /identity/v3/users/4f68657a55414ec39a27136701c41936 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:06.985918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:06.987364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.001125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8977e8-7990-48d6-afe2-bc3586aa0d4e service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.047918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.050596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.061107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:07.086322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.087077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.087773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.088153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] PATH_INFO: `/v3/users/8b4296b9c2f04b5db933d3cfde543d76` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.093137 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4296b9c2f04b5db933d3cfde543d76)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.095999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.162561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5769f-e362-4818-94d7-40c962e6c0f6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.172186 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.173070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.173428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.173640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] PATH_INFO: `/v3/projects/e5e06686b8844882abe52291672cab90` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.175214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e06686b8844882abe52291672cab90)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.177528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.181747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4296b9c2f04b5db933d3cfde543d76'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.193710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4296b9c2f04b5db933d3cfde543d76'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.194750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4296b9c2f04b5db933d3cfde543d76'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.206147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4296b9c2f04b5db933d3cfde543d76'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.223257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d62f9869-b405-4922-9851-0f79ba1f2165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4296b9c2f04b5db933d3cfde543d76'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.235380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1077/2192] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:06 2022] DELETE /identity/v3/users/8b4296b9c2f04b5db933d3cfde543d76 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:07.239425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.241442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.241747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.244716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e06686b8844882abe52291672cab90', 'request_id': 'req-bfb71766-1657-4e72-8168-501cfc86eccd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.253540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e06686b8844882abe52291672cab90', 'request_id': 'req-bfb71766-1657-4e72-8168-501cfc86eccd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.261083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e06686b8844882abe52291672cab90', 'request_id': 'req-bfb71766-1657-4e72-8168-501cfc86eccd'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.269104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:07.270360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.275073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] The token cache is being invalidate because project e5e06686b8844882abe52291672cab90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:07.275360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.275986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bfb71766-1657-4e72-8168-501cfc86eccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:07.277718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1116/2193] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:07 2022] DELETE /identity/v3/projects/e5e06686b8844882abe52291672cab90 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:07.286902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f7aa-2281-4780-987c-38ddf3f2c657 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.287190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f7aa-2281-4780-987c-38ddf3f2c657 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.287486 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f7aa-2281-4780-987c-38ddf3f2c657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.305287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:07.329842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d6f4f7aa-2281-4780-987c-38ddf3f2c657 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:07.331050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d6f4f7aa-2281-4780-987c-38ddf3f2c657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.346918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1078/2194] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:07.357632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.359614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.410288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1117/2195] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:07.417995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.418264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.418682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.431348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300449b6-0230-4378-8b8f-528217d3e618 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.436071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.436872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.437217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.437579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.442902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:07.444108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.447741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.449307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.454348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1118/2196] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:07.458587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.461279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1079/2197] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:07.468745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4121825-fe40-48e0-84c8-f5c974b37836 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.474078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.474771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.475128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.475400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.476181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:07.476483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.478110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.491619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1119/2198] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:13:07.495955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.506819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ad487-8bd6-4f2f-b751-3b3b2f7a8f2a service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.514344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.515141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.515462 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.516351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.516611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.519072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.526545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:07.557591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1080/2199] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:07 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:07.562428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.575472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c643bc-ba24-4e27-aa37-97e45e9825e0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.655896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.656537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.656924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.657109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.657883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.659885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.689777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1120/2200] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:07 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:07.693973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.707025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d655b-67a2-4957-9fbf-8e7e6fca37a6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.713859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.713859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.714112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.714336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.715148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.717278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.740778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1081/2201] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:07.742401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.758647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235069-c513-4783-9ce4-a346781b7089 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.766606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.767399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.767677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.767946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.768758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.770953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.801405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1121/2202] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:07.805318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.820596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2de51b-b891-401a-8223-9dd10125e36c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.829106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.832396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:07.834226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.834921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.835204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.835461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] PATH_INFO: `/v3/projects/a9563ec5f5a34babbed15a2b4469414b/users/036691cad2d94644b594624f4eb957b9/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.857831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317c594-dcda-4f4c-9406-2b2fac19f517 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:07.871419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:07.874303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:07.878090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:07.878090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] PATH_INFO: `/v3/projects/bae3b33e3275431c8bd3757662f3d1ae` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:07.878791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9563ec5f5a34babbed15a2b4469414b, user_id=036691cad2d94644b594624f4eb957b9, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.882352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae3b33e3275431c8bd3757662f3d1ae)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:07.887958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.890725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:07.923351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1082/2203] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:07 2022] PUT /identity/v3/projects/a9563ec5f5a34babbed15a2b4469414b/users/036691cad2d94644b594624f4eb957b9/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:07.924216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:07.929536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.009019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae3b33e3275431c8bd3757662f3d1ae', 'request_id': 'req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.025788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae3b33e3275431c8bd3757662f3d1ae', 'request_id': 'req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.030103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:08.036082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae3b33e3275431c8bd3757662f3d1ae', 'request_id': 'req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.056326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df185fa8-44e8-44f4-a48a-dae883fc0db1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.092867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] The token cache is being invalidate because project bae3b33e3275431c8bd3757662f3d1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:08.093422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.094764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5b8ecadd-b3b2-4c68-a5df-88985467b0e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.098129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1122/2204] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:07 2022] DELETE /identity/v3/projects/bae3b33e3275431c8bd3757662f3d1ae => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:08.099915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d268-b410-4b5b-a788-24e8208246df None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.105951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d268-b410-4b5b-a788-24e8208246df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.106463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d268-b410-4b5b-a788-24e8208246df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.142040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-88a6d268-b410-4b5b-a788-24e8208246df None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:08.143830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-88a6d268-b410-4b5b-a788-24e8208246df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.184746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.186277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.186707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.187230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] PATH_INFO: `/v3/users/74ed9818129642e9948bde474f0a4374` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.189716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ed9818129642e9948bde474f0a4374)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.191956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.248400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1123/2205] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:08.248400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.248400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.248400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.297406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ed9818129642e9948bde474f0a4374'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.311437 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ed9818129642e9948bde474f0a4374'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.312877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ed9818129642e9948bde474f0a4374'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.316614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:08.319481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:08.322024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.325195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ed9818129642e9948bde474f0a4374'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.333012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1124/2206] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:08.333720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.335042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.352597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4b6097cd-fd62-4b80-8038-3de61fc3491c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ed9818129642e9948bde474f0a4374'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:08.363598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1083/2207] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:07 2022] DELETE /identity/v3/users/74ed9818129642e9948bde474f0a4374 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:08.364927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12cbb-491b-45f0-b2ce-0dfbc42b0651 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.365211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12cbb-491b-45f0-b2ce-0dfbc42b0651 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.365579 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12cbb-491b-45f0-b2ce-0dfbc42b0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.389548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-93b12cbb-491b-45f0-b2ce-0dfbc42b0651 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:08.390785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-93b12cbb-491b-45f0-b2ce-0dfbc42b0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.412630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2bade-9b69-4185-9fb9-146792efb89d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.473710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.474322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.474772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.475050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.477297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.483785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1084/2208] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:08.485449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.485738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.486012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.496942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.499195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.508734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:08.510380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1125/2209] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:08.510845 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.511039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.523232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edf06a-3b39-456f-a9be-f0a5765cddad service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.531797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.535586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1085/2210] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:08.535767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.535767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.535767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.535767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:08.535767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.537027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.541842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.543517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:08.550594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1126/2211] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:08.555415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.568173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c09-5c84-406d-92cd-7c1e1e0f95f6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.569847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0289b30-dfb5-494d-a7fe-3d33d3fc6bd2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.575056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.576633 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.576951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.577163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.577440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.577636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.577728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.578123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.578846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.581314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.594625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.596294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.608283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1086/2212] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:08.629517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1127/2213] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:08.631292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.642884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5555ea-9ff4-4670-843b-42d3ae309f2b service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.723405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.724248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.724419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.724696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.725470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.727758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.761187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.761808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1087/2214] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:08.770785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:08.779620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35c19a-b5e8-4e70-8e2d-77ea41beabb2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.790069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.791369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.791777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.792243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.793519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.795421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.817267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1128/2215] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:08.819225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.831929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69012e-73ae-478d-920d-ab75126a96ad admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.838269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.839415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.839415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.839674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.840503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.842453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa00c4-2f36-4539-9c21-de3c97774244 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.855154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1088/2216] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:08.859547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:08.879517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e856-5f96-436b-8093-408f81ada32d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:08.884488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:08.885340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.885688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.886477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] PATH_INFO: `/v3/projects/fe600e6958134d9fac19e72a6650fbaf/users/5bcc6d22e0a7470299253a3e416ff955/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:08.906701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe600e6958134d9fac19e72a6650fbaf, user_id=5bcc6d22e0a7470299253a3e416ff955, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:08.909909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:08.942214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1129/2217] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:08 2022] PUT /identity/v3/projects/fe600e6958134d9fac19e72a6650fbaf/users/5bcc6d22e0a7470299253a3e416ff955/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:08.945412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:08.945837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:08.946128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.002224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] MFA Rules not processed for user `5bcc6d22e0a7470299253a3e416ff955`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:09.003753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:09.040413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:09.108539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1089/2218] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:09.120243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:09.122050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:09.203786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b00d-b641-4344-a3c2-275eaa3a49de admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:09.216539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:09.217462 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:09.217745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:09.218312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.249665 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:09.251965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:09.265309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:09.266774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:09.267419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1130/2219] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:09.441908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9851-af11-4497-894f-f7c57d2f2687 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:09.456930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:09.456930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:09.456930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:09.457283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] PATH_INFO: `/v3/projects/86f8e93897f54cf398c1234efdd1fa2c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.465799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f8e93897f54cf398c1234efdd1fa2c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:09.468689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:09.546432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:09.552315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:09.574192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bad9b-2d9c-43e1-885f-b929f1b03334 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:09.585465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f8e93897f54cf398c1234efdd1fa2c', 'request_id': 'req-d9e37886-7d5d-4ebb-ab20-410832bc9884'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.598005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f8e93897f54cf398c1234efdd1fa2c', 'request_id': 'req-d9e37886-7d5d-4ebb-ab20-410832bc9884'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.615262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f8e93897f54cf398c1234efdd1fa2c', 'request_id': 'req-d9e37886-7d5d-4ebb-ab20-410832bc9884'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.639917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] The token cache is being invalidate because project 86f8e93897f54cf398c1234efdd1fa2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:09.640259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.642261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.646695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1090/2220] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:09 2022] DELETE /identity/v3/projects/86f8e93897f54cf398c1234efdd1fa2c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:09.651016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:09.655932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:09.718917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:09.720600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:09.721026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:09.721703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] PATH_INFO: `/v3/users/327e18878b8f4b83854bc9652ea4a41f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.723136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327e18878b8f4b83854bc9652ea4a41f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:09.725733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:09.820554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:09.835655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e37886-7d5d-4ebb-ab20-410832bc9884 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:09.854429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:09.855120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:09.855402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:09.855627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327e18878b8f4b83854bc9652ea4a41f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.856069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] PATH_INFO: `/v3/users/89171f2da46a47c795fa6b413a43244a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.856437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327e18878b8f4b83854bc9652ea4a41f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.857941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89171f2da46a47c795fa6b413a43244a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:09.859922 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:09.904814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327e18878b8f4b83854bc9652ea4a41f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.924562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327e18878b8f4b83854bc9652ea4a41f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.925339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-64278269-961b-4bfb-bbc3-428c066b1fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327e18878b8f4b83854bc9652ea4a41f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:09.927473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:09.967753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1131/2221] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:09 2022] DELETE /identity/v3/users/327e18878b8f4b83854bc9652ea4a41f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:09.970310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:09.970840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:09.971262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:09.997305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89171f2da46a47c795fa6b413a43244a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.010026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:10.011150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:10.011613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89171f2da46a47c795fa6b413a43244a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.012796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89171f2da46a47c795fa6b413a43244a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.032446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89171f2da46a47c795fa6b413a43244a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.053070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89171f2da46a47c795fa6b413a43244a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.064766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1091/2222] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:09 2022] DELETE /identity/v3/users/89171f2da46a47c795fa6b413a43244a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:10.122689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1132/2223] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:10.149174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:10.152528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:10.247958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10df48-8248-4fe1-8bd8-6d8b3e895028 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:10.252396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:10.253405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:10.253931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:10.254392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:10.357435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:10.359016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d16d-7453-4946-af29-81ad8c6927f9 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:10.374432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1092/2224] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:10.546659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:10.548117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:10.574325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e55f10-c575-42f3-bb7d-0f1a3fc58e7a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:10.582126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:10.582854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:10.583140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:10.583498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] PATH_INFO: `/v3/projects/b349d2dcdf5c4700830073df552d511e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:10.585224 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b349d2dcdf5c4700830073df552d511e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:10.587150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:10.696475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b349d2dcdf5c4700830073df552d511e', 'request_id': 'req-65b7410c-b9de-4b9e-95d6-d89f0588843a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.707374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b349d2dcdf5c4700830073df552d511e', 'request_id': 'req-65b7410c-b9de-4b9e-95d6-d89f0588843a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.714891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b349d2dcdf5c4700830073df552d511e', 'request_id': 'req-65b7410c-b9de-4b9e-95d6-d89f0588843a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.730731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] The token cache is being invalidate because project b349d2dcdf5c4700830073df552d511e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:10.731055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.731688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65b7410c-b9de-4b9e-95d6-d89f0588843a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:10.735899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1133/2225] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:10 2022] DELETE /identity/v3/projects/b349d2dcdf5c4700830073df552d511e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:10.742669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:10.743054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:10.743882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:10.776050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:10.777466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:10.804975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:10.891249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1093/2226] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:10.902416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:10.902841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:10.902982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:10.939460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:10.941549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:10.953493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1134/2227] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:10.955303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:10.979805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e10dcd-e62d-4e73-9b66-db75dad03668 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:10.995984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:10.996631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:10.996934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:10.997366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:10.999008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:10.999332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.000990 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.067379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1094/2228] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:11.072236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.093735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b28fb-2da1-4d94-ad67-c77a9398d6da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.103327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.105062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.106717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.107562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.109281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.112024 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.117180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.122871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:11.147240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28529-4d50-408c-acd0-4395f126d977 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.154549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.156842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.157131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.157413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] PATH_INFO: `/v3/projects/cb6a49d333e5430d8b58fafb7fe7dfb4` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.159059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6a49d333e5430d8b58fafb7fe7dfb4)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.161353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.186452 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1135/2229] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:11 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:11.190984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.245659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6a49d333e5430d8b58fafb7fe7dfb4', 'request_id': 'req-02a27672-1014-4191-9572-e8f9fd919bb4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.253921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6a49d333e5430d8b58fafb7fe7dfb4', 'request_id': 'req-02a27672-1014-4191-9572-e8f9fd919bb4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.260798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6a49d333e5430d8b58fafb7fe7dfb4', 'request_id': 'req-02a27672-1014-4191-9572-e8f9fd919bb4'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.281841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] The token cache is being invalidate because project cb6a49d333e5430d8b58fafb7fe7dfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:11.282055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.283040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.285019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1095/2230] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:11 2022] DELETE /identity/v3/projects/cb6a49d333e5430d8b58fafb7fe7dfb4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:11.289857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.292587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:11.305424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:11.331204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cb673-30fe-4a95-8fe1-d5cd940317cb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.421915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a27672-1014-4191-9572-e8f9fd919bb4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.426339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.427134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.427318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.427587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.428408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.429403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.430478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.431071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.431496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] PATH_INFO: `/v3/users/df67ffb6047a44c1846f464219155ea1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.432286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.434017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df67ffb6047a44c1846f464219155ea1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.436455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.467383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1136/2231] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:11 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:11.471300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.473273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:11.487364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650475-e2a2-4485-97cc-70ee181407ac admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.492658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.493310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.494020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.494365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.495005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.496604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.500367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:11.512781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df67ffb6047a44c1846f464219155ea1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.512998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1137/2232] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:11.516473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.521212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df67ffb6047a44c1846f464219155ea1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.522040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df67ffb6047a44c1846f464219155ea1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.531434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df67ffb6047a44c1846f464219155ea1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.531647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b336-53e1-4b1d-bc29-3b9a3d952d86 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.538277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.538277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.538277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.538277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.538998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.540596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.551258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ea5188b5-7b3b-436d-bf4a-d4bee825b437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df67ffb6047a44c1846f464219155ea1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:11.552182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1138/2233] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:11.556121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.557862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:11.559407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1096/2234] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:11 2022] DELETE /identity/v3/users/df67ffb6047a44c1846f464219155ea1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:11.571030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc057851-9932-4d1e-b0fe-f521c8beea42 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:11.672389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:11.673874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.674536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.674883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] PATH_INFO: `/v3/projects/68e4c32c98a54d9eb2fd5db4a4d2de5a/users/4acd76ea06c9457c8492bd598ce43c0c/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.708727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e4c32c98a54d9eb2fd5db4a4d2de5a, user_id=4acd76ea06c9457c8492bd598ce43c0c, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:11.711607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:11.738059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1139/2235] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:11 2022] PUT /identity/v3/projects/68e4c32c98a54d9eb2fd5db4a4d2de5a/users/4acd76ea06c9457c8492bd598ce43c0c/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:11.751809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:11.752262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:11.752605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:11.824186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] MFA Rules not processed for user `4acd76ea06c9457c8492bd598ce43c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:11.825491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:11.931622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1097/2236] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:11.936685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.963213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:11.965692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:12.024263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:12.064873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4c55a-c770-4712-948e-7f73e6c728d9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.073522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.074404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.074968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.075400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.076942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.077373 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b746427-46b2-4173-907c-a08deaecce99 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.079803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.082765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.083430 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.083869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.084152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] PATH_INFO: `/v3/projects/e20e4ba0511b43fa8cb9cc4d129d3d55` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.085358 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20e4ba0511b43fa8cb9cc4d129d3d55)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.087886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.167461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1140/2237] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:11 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:12.172502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:12.206447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:12.215454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20e4ba0511b43fa8cb9cc4d129d3d55', 'request_id': 'req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.234147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20e4ba0511b43fa8cb9cc4d129d3d55', 'request_id': 'req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.252248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20e4ba0511b43fa8cb9cc4d129d3d55', 'request_id': 'req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.277087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] The token cache is being invalidate because project e20e4ba0511b43fa8cb9cc4d129d3d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:12.278109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.279597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.282073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1098/2238] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:11 2022] DELETE /identity/v3/projects/e20e4ba0511b43fa8cb9cc4d129d3d55 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:12.286478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:12.288104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:12.325155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9623-97f4-4e52-bfdb-4f4cda8ed505 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.395124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604db1-e1c9-41ff-94f4-d9a97a6c3119 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.408252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.409174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.409539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.409886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] PATH_INFO: `/v3/users/adf5963d68854c7d8f707d3dc32b32d8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.411215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf5963d68854c7d8f707d3dc32b32d8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.413791 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.415985 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.417374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.417815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.418659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.420229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.427104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.478620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1141/2239] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:12 2022] POST /identity/v3/users => generated 294 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:12.485347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:12.488137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:12.512738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad771-4687-4bf9-b821-845f2dd21ada admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.519179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.519961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.520367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.520789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.530908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.536366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf5963d68854c7d8f707d3dc32b32d8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.540815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.553395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf5963d68854c7d8f707d3dc32b32d8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.555428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf5963d68854c7d8f707d3dc32b32d8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.558036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1142/2240] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:12.565642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:12.585671 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf5963d68854c7d8f707d3dc32b32d8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.593988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2d93-b865-4707-bb60-790e6957b8cf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:12.608203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf5963d68854c7d8f707d3dc32b32d8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:12.618376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1099/2241] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:12 2022] DELETE /identity/v3/users/adf5963d68854c7d8f707d3dc32b32d8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:12.625011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:12.626722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:12.627019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:12.627437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] PATH_INFO: `/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d/users/c1b1d1466c94423b961780cb449a31c5/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:12.675489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a6fb75605a4ceb9fb96409fa52d91d, user_id=c1b1d1466c94423b961780cb449a31c5, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:12.681025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:12.714149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1143/2242] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:12 2022] PUT /identity/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d/users/c1b1d1466c94423b961780cb449a31c5/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:12.718998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:12.720751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:12.852997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:12.870958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25647b-51e4-4217-ba67-e0b8eab132fb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.015580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.016964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.017352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.017723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.018795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.028325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20557-4af3-43db-8633-bff0b2b9343a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.045027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1100/2243] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:13.048957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.067944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f492-7312-4363-a088-08bf4da918ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.074110 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.074980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.075114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.075339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] PATH_INFO: `/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d/users/c1b1d1466c94423b961780cb449a31c5/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.079767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a6fb75605a4ceb9fb96409fa52d91d, user_id=c1b1d1466c94423b961780cb449a31c5, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.092005 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.121447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1144/2244] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:13 2022] PUT /identity/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d/users/c1b1d1466c94423b961780cb449a31c5/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:13.122621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.123185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.124243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.135278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.150296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.175390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] MFA Rules not processed for user `c1b1d1466c94423b961780cb449a31c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:13.176842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.187691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:13.285752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850d1c-4b43-4a4b-bf7d-2cfdbefa4ab9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.294973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1101/2245] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:13.301269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.302160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.302582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.303012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] PATH_INFO: `/v3/projects/366cf72773234731aceb86423aa24096` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.304470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=366cf72773234731aceb86423aa24096)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.305460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.307588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.308031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.384038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366cf72773234731aceb86423aa24096', 'request_id': 'req-86fe301c-541e-4f08-91ce-280000066f7c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:13.393076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366cf72773234731aceb86423aa24096', 'request_id': 'req-86fe301c-541e-4f08-91ce-280000066f7c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:13.401463 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e80b2f-66ac-4330-b059-2c11869b9dc5 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.405407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366cf72773234731aceb86423aa24096', 'request_id': 'req-86fe301c-541e-4f08-91ce-280000066f7c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:13.424244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] The token cache is being invalidate because project 366cf72773234731aceb86423aa24096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:13.424556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:13.426901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86fe301c-541e-4f08-91ce-280000066f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:13.435424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1145/2246] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:13 2022] DELETE /identity/v3/projects/366cf72773234731aceb86423aa24096 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:13.437006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea056-05fa-4c40-8f1e-dbd11efa2401 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.437380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea056-05fa-4c40-8f1e-dbd11efa2401 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.437554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea056-05fa-4c40-8f1e-dbd11efa2401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.477732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea0ea056-05fa-4c40-8f1e-dbd11efa2401 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:13.479378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea0ea056-05fa-4c40-8f1e-dbd11efa2401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.487582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:13.519215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.520202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.520902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.521426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.528588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.588509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1146/2247] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:13.599571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.599939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.600212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.627336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:13.629281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:13.633570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.635173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.643834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1147/2248] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:13.648924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.654731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1102/2249] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:13.663327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249dea8-cee6-4584-9a96-9ac50083c2ba None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.670912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.671905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.672718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.673230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.674099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:13.674894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.677245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.704893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.713295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1148/2250] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:13.720252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1c3cf-02b0-4577-b0dd-13ef8905296d service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.725624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.727142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.727420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.727694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.728870 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.731188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:13.793749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1103/2251] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:13 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:13.797706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:13.813126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdfa99-d375-4e1f-8784-5adeb556c3aa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:13.884165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:13.992715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:13.993586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:13.993718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:13.994009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:13.994800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:13.999073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:14.048689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1149/2252] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:13 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:14.058465 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:14.071826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3842e5-e958-43c3-9695-a8ff6e561ac1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:14.108181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:14.110327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:14.110881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:14.122253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:14.130785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:14.134736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:14.150948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1104/2253] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:14.156121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:14.171032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6a52-da5d-4589-ad7a-dad911c68d42 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:14.177883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:14.178749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:14.179495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:14.180184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:14.181129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:14.182989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ccda-e6f3-4061-9104-30a9f982141e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:14.200932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1150/2254] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:14.224132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:14.234138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2999d-8d3b-4464-9f7b-c0ad7b31ced3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:14.239773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:14.241528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:14.241528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:14.241726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] PATH_INFO: `/v3/projects/9fc6218685e94a52aa1300a86815b45f/users/a65e1442d8034f7c848b8e97c3610455/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:14.273571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc6218685e94a52aa1300a86815b45f, user_id=a65e1442d8034f7c848b8e97c3610455, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:14.276596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:14.342436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1105/2255] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:14 2022] PUT /identity/v3/projects/9fc6218685e94a52aa1300a86815b45f/users/a65e1442d8034f7c848b8e97c3610455/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:14.358305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13aa4-63b4-48b8-b801-53e18371a9e2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:14.359331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13aa4-63b4-48b8-b801-53e18371a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:14.359706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13aa4-63b4-48b8-b801-53e18371a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:14.419869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cce13aa4-63b4-48b8-b801-53e18371a9e2 None None] MFA Rules not processed for user `a65e1442d8034f7c848b8e97c3610455`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:14.421229 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cce13aa4-63b4-48b8-b801-53e18371a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:14.536519 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:14.537396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1151/2256] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:14.542324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:14.615028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bd77c-50bd-499c-a600-5ef7bf416def admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:14.619369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:14.620319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:14.620541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:14.620974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:14.633392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:14.635105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35409b-6177-4a90-bca3-2cbc86726d4e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:14.648420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1106/2257] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:15.659090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:15.659595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:15.659676 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:15.695112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] MFA Rules not processed for user `036691cad2d94644b594624f4eb957b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:15.697875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:15.797185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1152/2258] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:15.808788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:15.809621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:15.810590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:15.839240 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] MFA Rules not processed for user `036691cad2d94644b594624f4eb957b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:15.840385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:15.851265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1107/2259] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:15.863776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:15.865715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:15.899273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:15.955931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16bf2a-7b60-4fe1-a60f-94b90ce097fd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:15.962067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:15.963148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:15.963427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:15.963693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:15.974138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:15.975813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be6a76-f518-4213-87ac-67d31e8b9a10 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:15.988086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1153/2260] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:16.785617 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:16.787247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:16.837956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:16.880102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14fe5-312d-4c0c-85c3-94996b16adeb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:16.884755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:16.885624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:16.885948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:16.886251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] PATH_INFO: `/v3/users/4acd76ea06c9457c8492bd598ce43c0c` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:16.887613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4acd76ea06c9457c8492bd598ce43c0c)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:16.889785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:16.948900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4acd76ea06c9457c8492bd598ce43c0c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:16.956735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4acd76ea06c9457c8492bd598ce43c0c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:16.958251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4acd76ea06c9457c8492bd598ce43c0c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:16.970696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4acd76ea06c9457c8492bd598ce43c0c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:16.988996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1756787e-39d0-453c-93d6-2f00b74770d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4acd76ea06c9457c8492bd598ce43c0c'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:16.996674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1108/2261] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:16 2022] DELETE /identity/v3/users/4acd76ea06c9457c8492bd598ce43c0c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:17.001666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:17.008574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:17.008574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:17.023787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:17.024291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:17.024582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:17.049286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:17.049539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] MFA Rules not processed for user `036691cad2d94644b594624f4eb957b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:17.050689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:17.050804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:17.144378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1154/2262] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:17.150301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1109/2263] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:17.155883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:17.157819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:17.257307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da72b-8596-4bbf-88f3-2c54ef0c5b5d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:17.263619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:17.264265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:17.264546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:17.264860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:17.275677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:17.277180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:17.306578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1155/2264] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:18.042134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:18.051941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:18.116376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4abd9-573c-4bcd-b6a9-1bf0685ebcb0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:18.152610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:18.153308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:18.153768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:18.154416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] PATH_INFO: `/v3/projects/68e4c32c98a54d9eb2fd5db4a4d2de5a` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:18.156152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e4c32c98a54d9eb2fd5db4a4d2de5a)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:18.158117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:18.333016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e4c32c98a54d9eb2fd5db4a4d2de5a', 'request_id': 'req-f77fd323-f459-4a9f-a483-00c905d2d9c8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.335390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:18.353000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e4c32c98a54d9eb2fd5db4a4d2de5a', 'request_id': 'req-f77fd323-f459-4a9f-a483-00c905d2d9c8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.361569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e4c32c98a54d9eb2fd5db4a4d2de5a', 'request_id': 'req-f77fd323-f459-4a9f-a483-00c905d2d9c8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.384578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] The token cache is being invalidate because project 68e4c32c98a54d9eb2fd5db4a4d2de5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:18.385226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.388418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.393027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1110/2265] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:18 2022] DELETE /identity/v3/projects/68e4c32c98a54d9eb2fd5db4a4d2de5a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:18.400917 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:18.415784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7987c-72de-4af1-9edc-f54f090cc4fc service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:18.578239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:18.588154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:18.588949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:18.589223 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:18.589671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] PATH_INFO: `/v3/users/c1b1d1466c94423b961780cb449a31c5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:18.591720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b1d1466c94423b961780cb449a31c5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:18.594012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:18.705298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b1d1466c94423b961780cb449a31c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.706249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b1d1466c94423b961780cb449a31c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.732846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b1d1466c94423b961780cb449a31c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.746280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b1d1466c94423b961780cb449a31c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.746983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f9b6d7f-6352-4e31-9b01-35f7a9cd443a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b1d1466c94423b961780cb449a31c5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:18.783614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1156/2266] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:18 2022] DELETE /identity/v3/users/c1b1d1466c94423b961780cb449a31c5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:19.552612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:19.555282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:19.594548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fd323-f459-4a9f-a483-00c905d2d9c8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:19.677872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:19.678541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:19.678836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:19.679228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] PATH_INFO: `/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:19.680576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a6fb75605a4ceb9fb96409fa52d91d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:19.682527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:19.743247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a6fb75605a4ceb9fb96409fa52d91d', 'request_id': 'req-aa5d18a7-fdbe-4516-840c-66cb977606f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:19.751350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a6fb75605a4ceb9fb96409fa52d91d', 'request_id': 'req-aa5d18a7-fdbe-4516-840c-66cb977606f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:19.757421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a6fb75605a4ceb9fb96409fa52d91d', 'request_id': 'req-aa5d18a7-fdbe-4516-840c-66cb977606f7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:19.777730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] The token cache is being invalidate because project a9a6fb75605a4ceb9fb96409fa52d91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:19.778017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:19.778666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-aa5d18a7-fdbe-4516-840c-66cb977606f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:19.780180 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1111/2267] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:19 2022] DELETE /identity/v3/projects/a9a6fb75605a4ceb9fb96409fa52d91d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:19.784984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:19.785453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:19.785692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:19.814629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:19.815939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:19.879836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1157/2268] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:19.887526 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:19.891168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:19.891480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:19.930296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:19.931483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:19.939901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1112/2269] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:19.944241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:19.960220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec154d9-a031-4296-b0a0-c1632d413b6d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:19.965649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:19.966397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:19.966750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:19.967131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:19.967969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:19.968341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:19.970062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.000796 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1158/2270] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:20.001487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.014435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f8a4-4694-4ed0-a324-c56a35e51ee9 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.020681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.020681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.020681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.020681 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.021408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.023013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.081193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1113/2271] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:20 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:20.086906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.108998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd930b8-6f0a-40e3-a95b-b6b4ee58ebad admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.255259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.255899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.256180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.256612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.257333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.259330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.270415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:20.310595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1159/2272] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:20 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:20.312374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.330184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acff41-4299-4389-b4c4-f011b2315388 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.331839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.333480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.334129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.334679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.337690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.345751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.365472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1114/2273] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:20.367321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.383952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089463b6-e8c5-4607-a975-95a35c47429c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.399771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.404918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.405249 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.405662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.406399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.410797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d12f06-abfd-41d5-aa0e-edcd169ea4aa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.462126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1160/2274] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:20.463666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.493704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31475d37-ad21-4b10-a9cd-c540806cc52e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.508169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.508889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.509172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.509449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] PATH_INFO: `/v3/projects/78d881236d8243e78d081afdc8a8a2a1/users/43c9dd968d4248c4bd597f518a99901a/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.531998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d881236d8243e78d081afdc8a8a2a1, user_id=43c9dd968d4248c4bd597f518a99901a, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.535116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.565743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1115/2275] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:20 2022] PUT /identity/v3/projects/78d881236d8243e78d081afdc8a8a2a1/users/43c9dd968d4248c4bd597f518a99901a/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:20.579316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.580835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.581887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.623732 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] MFA Rules not processed for user `43c9dd968d4248c4bd597f518a99901a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:20.625339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:20.730328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1161/2276] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:20.744226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:20.747262 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:20.755269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:20.850851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e3ef-dfbe-4040-a0a4-d682a40b9834 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:20.855387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:20.856190 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:20.856601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:20.857156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:20.868377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:20.870118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3ce39-31d1-4835-9094-d42e39de8473 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:20.892575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1116/2277] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:20.909586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:21.006648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3222923-749e-4e8c-8c76-1eac2774d9f6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:21.011544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:21.012307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.012679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.013655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] PATH_INFO: `/v3/users/43c9dd968d4248c4bd597f518a99901a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.015167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c9dd968d4248c4bd597f518a99901a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:21.017146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:21.083536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c9dd968d4248c4bd597f518a99901a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.084348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c9dd968d4248c4bd597f518a99901a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.115688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c9dd968d4248c4bd597f518a99901a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.121256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:21.133921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c9dd968d4248c4bd597f518a99901a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.137550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c9dd968d4248c4bd597f518a99901a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.171858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1162/2278] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:20 2022] DELETE /identity/v3/users/43c9dd968d4248c4bd597f518a99901a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:21.174029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.174857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.175116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.208956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:21.210997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.288095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1117/2279] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:21.298233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:21.301547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.380940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b393f-17a5-4312-9c2d-51885104d20a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:21.385725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:21.386427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.386774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.387112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.398087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:21.400138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:21.413492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1163/2280] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:21.714686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:21.718053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.737134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bb71-a14c-482f-96e8-d9d89ca991cb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:21.746251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:21.747242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.747636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.748149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] PATH_INFO: `/v3/users/a65e1442d8034f7c848b8e97c3610455` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.749777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65e1442d8034f7c848b8e97c3610455)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:21.752536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:21.769076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:21.770520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.784339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb18f-49e1-4cfc-ae90-601a0f8dc057 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:21.791789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:21.795753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.796217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.796866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] PATH_INFO: `/v3/projects/78d881236d8243e78d081afdc8a8a2a1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.798492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d881236d8243e78d081afdc8a8a2a1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:21.801122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:21.838025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65e1442d8034f7c848b8e97c3610455'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.847138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65e1442d8034f7c848b8e97c3610455'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.847835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65e1442d8034f7c848b8e97c3610455'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.858413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65e1442d8034f7c848b8e97c3610455'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.865825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d881236d8243e78d081afdc8a8a2a1', 'request_id': 'req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.873148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-0df0f704-e82d-42e2-9f9a-16721e41820a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65e1442d8034f7c848b8e97c3610455'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.873435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d881236d8243e78d081afdc8a8a2a1', 'request_id': 'req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.880237 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1118/2281] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:21 2022] DELETE /identity/v3/users/a65e1442d8034f7c848b8e97c3610455 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:21.880755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d881236d8243e78d081afdc8a8a2a1', 'request_id': 'req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.885635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.886166 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.886450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.899188 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] The token cache is being invalidate because project 78d881236d8243e78d081afdc8a8a2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:21.899503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.900108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f99a802e-eada-47dc-ba0d-29e08ffd2a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:21.901888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1164/2282] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:21 2022] DELETE /identity/v3/projects/78d881236d8243e78d081afdc8a8a2a1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:21.906951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf51d-85c0-4b71-a023-05a62ffd8872 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:21.907228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf51d-85c0-4b71-a023-05a62ffd8872 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:21.907499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbf51d-85c0-4b71-a023-05a62ffd8872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:21.907657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:21.908871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.924035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:21.932546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2fdbf51d-85c0-4b71-a023-05a62ffd8872 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:21.933823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2fdbf51d-85c0-4b71-a023-05a62ffd8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:21.985471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1119/2283] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:21.998296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.000798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:22.065615 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1165/2284] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:22.071511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.071511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.073322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.113250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb0e58-15e4-4187-b82f-c4e320a44d24 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.114698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:22.115957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:22.120804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.121888 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.123110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.124254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.127070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1166/2285] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:22.132251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.156436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.158271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.179503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6569d-b645-4169-894d-006bd9032ec1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.183515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1120/2286] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:22.193196 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.194064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.194584 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.195699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.197015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:22.197541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.201565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.203842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:22.226133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1167/2287] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:22.231074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.253376 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c857055-5548-4743-83a5-f995db7fff62 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.262488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.264481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.265170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.265653 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.266548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.270655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.327374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1121/2288] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:22 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:22.329313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.357866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f0c47-5d0c-4e8f-84a0-65ae7d2b6a9e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.466888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.467628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.467945 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.468175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.469064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.470944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.504728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1168/2289] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:22 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:22.505669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.538164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219836-07e7-47f5-843a-fbe5b0c0393d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.550628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.553750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.554034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.554309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.555034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.560619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.577268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1122/2290] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:22.581590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.591291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.593683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8f681-d09a-4f87-a875-afa8969101eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.593811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:22.606690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.607339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.607784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.607903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.608581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.612248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.623163 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110862a1-a37b-4f1c-9ba5-70e2bc3b63ea admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.643943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1169/2291] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:22.645537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:22.646566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.647244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.647958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.647958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] PATH_INFO: `/v3/projects/9fc6218685e94a52aa1300a86815b45f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.649288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc6218685e94a52aa1300a86815b45f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.659583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.674313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165507a1-aa61-47a5-bc82-bd891ffb642d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:22.682398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:22.684089 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.684706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.685963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] PATH_INFO: `/v3/projects/07987538c7744068ad1ba90d6cdddb41/users/7c07db848ec94ebeb03f453b659b92aa/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.717430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07987538c7744068ad1ba90d6cdddb41, user_id=7c07db848ec94ebeb03f453b659b92aa, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:22.720165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc713b-67a8-4545-9d4c-dff3d67a3182 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:22.746392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc6218685e94a52aa1300a86815b45f', 'request_id': 'req-116f3f18-fc5c-4da1-94fc-6dd57db74366'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:22.756349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1170/2292] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:22 2022] PUT /identity/v3/projects/07987538c7744068ad1ba90d6cdddb41/users/7c07db848ec94ebeb03f453b659b92aa/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:22.762508 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc6218685e94a52aa1300a86815b45f', 'request_id': 'req-116f3f18-fc5c-4da1-94fc-6dd57db74366'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:22.767439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:22.767896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:22.768006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:22.784933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc6218685e94a52aa1300a86815b45f', 'request_id': 'req-116f3f18-fc5c-4da1-94fc-6dd57db74366'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:22.807304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] The token cache is being invalidate because project 9fc6218685e94a52aa1300a86815b45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:22.807675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:22.808604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:22.817803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] MFA Rules not processed for user `7c07db848ec94ebeb03f453b659b92aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:22.820313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:22.825491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1123/2293] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:22 2022] DELETE /identity/v3/projects/9fc6218685e94a52aa1300a86815b45f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:22.993580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1171/2294] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:23.190027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:23.191625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:23.221253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:23.322881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f3f18-fc5c-4da1-94fc-6dd57db74366 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:23.438691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:23.439663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:23.439949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:23.440296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:23.454548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:23.456106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2593508-44b0-49ef-b949-706200703521 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:23.468481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1124/2295] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:30.279605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:30.281075 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:30.324254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:30.364951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee355c-35b0-4d8c-ba9f-e16954445fa7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:30.369894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:30.370579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:30.370852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:30.371120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] PATH_INFO: `/v3/users/5bcc6d22e0a7470299253a3e416ff955` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:30.373164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcc6d22e0a7470299253a3e416ff955)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:30.375064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:30.428093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcc6d22e0a7470299253a3e416ff955'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:30.428846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcc6d22e0a7470299253a3e416ff955'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:30.443471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcc6d22e0a7470299253a3e416ff955'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:30.454527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcc6d22e0a7470299253a3e416ff955'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:30.455499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcc6d22e0a7470299253a3e416ff955'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:30.474057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1172/2296] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:30 2022] DELETE /identity/v3/users/5bcc6d22e0a7470299253a3e416ff955 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:30.477133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:30.477587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:30.477734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:30.521746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:30.522976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:30.604868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1125/2297] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:30.617749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:30.619407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:30.707406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca018849-5f0d-4784-815b-8c116ff0ee11 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:30.711140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:30.711679 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:30.711864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:30.712131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:30.724347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:30.726234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9263fb-1e33-4a5f-ade1-34261252aae6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:30.741786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1173/2298] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:31.111017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.112731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:31.135078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16767b-7373-4b0f-bf77-ec0331e932ba None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.141986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.142652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.142930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.143205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] PATH_INFO: `/v3/projects/fe600e6958134d9fac19e72a6650fbaf` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.144372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe600e6958134d9fac19e72a6650fbaf)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.146377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.203582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe600e6958134d9fac19e72a6650fbaf', 'request_id': 'req-ab0f8186-c53c-4ac7-af43-cda406d654dc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:31.210251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe600e6958134d9fac19e72a6650fbaf', 'request_id': 'req-ab0f8186-c53c-4ac7-af43-cda406d654dc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:31.217880 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe600e6958134d9fac19e72a6650fbaf', 'request_id': 'req-ab0f8186-c53c-4ac7-af43-cda406d654dc'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:31.221919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:31.233281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] The token cache is being invalidate because project fe600e6958134d9fac19e72a6650fbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:31.233874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:31.234807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ab0f8186-c53c-4ac7-af43-cda406d654dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:31.236320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1126/2299] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:31 2022] DELETE /identity/v3/projects/fe600e6958134d9fac19e72a6650fbaf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:31.242415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.242702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.242974 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.264119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:31.265361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:31.320719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:31.332443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1174/2300] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:31.349933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.350461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.350761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.373098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:31.374464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:31.382691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1127/2301] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:31.387239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.399148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419282a1-4d54-4154-90fd-9e956393bf81 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.402513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.403132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.403442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.403717 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.404416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:31.404749 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.406515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.419100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1175/2302] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:31.423624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.432942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ce85-8ce8-478e-b8d8-a8be39541cdc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.438524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.439202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.439488 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.439762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.440428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.442396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.474800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1128/2303] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:31 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:31.476377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.490568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b325f-9def-47e2-ba6b-82725c4981ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.551433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.552047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.552476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.552588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.553287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.555179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.580329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1176/2304] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:31 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:31.581779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.592863 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ada42-3a05-4dde-a90f-5b81fc25fdba admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.597507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.598115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.598391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.598657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.599341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.600964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.615517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1129/2305] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:31.617318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.634900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1561e-d57f-46d9-876e-d8678666fd84 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.640261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.640923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.641198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.641461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.642156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.643757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde4cc-452e-4cd8-b527-38ad3b4394d9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.659983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1177/2306] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:31.661178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.676053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3ca0-be24-4ac8-a50a-3aa5708b1745 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.684364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.685321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.685627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.685906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] PATH_INFO: `/v3/projects/135bf7ffddf64067a46fa88b1902a725/users/501136f66e1a405c9a2c42dbe000a993/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.701655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135bf7ffddf64067a46fa88b1902a725, user_id=501136f66e1a405c9a2c42dbe000a993, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.704345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.721634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1130/2307] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:31 2022] PUT /identity/v3/projects/135bf7ffddf64067a46fa88b1902a725/users/501136f66e1a405c9a2c42dbe000a993/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:31.733144 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.733429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.733698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.776501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] MFA Rules not processed for user `501136f66e1a405c9a2c42dbe000a993`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:31.777657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:31.869608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1178/2308] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:31.883759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:31.885616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:31.944107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc939e-33c5-471b-9c71-43a45db704d9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:31.948105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:31.948979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:31.949277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:31.949546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:31.958080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:31.959497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197b92c-9e30-4375-8479-b7636db78031 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:31.968900 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1131/2309] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:35.248263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:35.249761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:35.315602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:35.325524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de171c-603a-4355-9afd-3d1db96d00b6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:35.333882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:35.334788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:35.335199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:35.335548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] PATH_INFO: `/v3/users/7c07db848ec94ebeb03f453b659b92aa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:35.338366 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c07db848ec94ebeb03f453b659b92aa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:35.342083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:35.415413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c07db848ec94ebeb03f453b659b92aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:35.416218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c07db848ec94ebeb03f453b659b92aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:35.429345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c07db848ec94ebeb03f453b659b92aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:35.437375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c07db848ec94ebeb03f453b659b92aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:35.438059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c07db848ec94ebeb03f453b659b92aa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:35.453246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1179/2310] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:35 2022] DELETE /identity/v3/users/7c07db848ec94ebeb03f453b659b92aa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:35.457726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:35.458249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:35.458536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:35.478733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:35.479930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:35.554059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1132/2311] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:35.563926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:35.565533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:35.630424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2062d46-eae4-4210-a7f9-c2a81ca1faa7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:35.634441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:35.635063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:35.635397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:35.635693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:35.645239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:35.646636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5fdc-ec92-4baa-af6d-cc4833bcc3c2 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:35.657692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1180/2312] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:35.946717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:35.948682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:35.977429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3b963-fd79-4f80-9312-ea998360e24a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:35.983419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:35.984134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:35.984435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:35.984983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] PATH_INFO: `/v3/projects/07987538c7744068ad1ba90d6cdddb41` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:35.986245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07987538c7744068ad1ba90d6cdddb41)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:35.989114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.030542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:36.044815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07987538c7744068ad1ba90d6cdddb41', 'request_id': 'req-afd9b943-c30e-437d-ab49-a77e1f0e879e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:36.050977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07987538c7744068ad1ba90d6cdddb41', 'request_id': 'req-afd9b943-c30e-437d-ab49-a77e1f0e879e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:36.056454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07987538c7744068ad1ba90d6cdddb41', 'request_id': 'req-afd9b943-c30e-437d-ab49-a77e1f0e879e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:36.069214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] The token cache is being invalidate because project 07987538c7744068ad1ba90d6cdddb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:36.069490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:36.070089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-afd9b943-c30e-437d-ab49-a77e1f0e879e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:36.071586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1133/2313] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:35 2022] DELETE /identity/v3/projects/07987538c7744068ad1ba90d6cdddb41 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:36.077995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.078276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.078544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.097925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:36.099141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:36.162973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1181/2314] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:36.171246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.171532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.171805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.191419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:36.192623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:36.201310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1134/2315] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:36.205588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.216523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e61ef-1f30-49e5-b2d4-7aa4cb5aa601 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.221120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.221720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.221994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.222260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.222977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:36.223275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.224878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.236752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1182/2316] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:36.241071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.255033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128241b7-9831-4af7-878b-6b1635fc037e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.265131 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.266399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.267194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.267819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.269203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.272192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.316146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1135/2317] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:36.319016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.326261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:36.330112 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3792-4d93-4c3c-95f2-b766a7ae29da admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.398201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.398815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.399096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.399368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.400025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.402002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.423124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1183/2318] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:36 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:36.426936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.437582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3164a-fc20-4ad8-a32d-fa2c1854de49 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.442434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.443057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.443338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.443610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.444307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.445926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.459608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1136/2319] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:36.460791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.472509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c34c-97df-4cfb-9a8d-575f96bb317d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.479250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.480520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.483783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.483783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.483783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.485989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc541569-ac4b-47ed-adf0-145f47b9e81a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.503041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1184/2320] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:36.504234 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.516212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a104c-3451-4f01-9b11-005f8669b86c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.521952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.522630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.522906 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.523179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] PATH_INFO: `/v3/projects/51a036f5d3ae444ca8cc9ab201df6f89/users/4512745d3df04222851af1683753574f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.551624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a036f5d3ae444ca8cc9ab201df6f89, user_id=4512745d3df04222851af1683753574f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.555062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.571702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1137/2321] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:36 2022] PUT /identity/v3/projects/51a036f5d3ae444ca8cc9ab201df6f89/users/4512745d3df04222851af1683753574f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:36.577419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.577702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.577971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.597723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:36.598942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:36.673441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1185/2322] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:36.683439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:36.686730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:36.772213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952e077-1f8c-4354-ae77-7a47b9b9e901 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:36.776891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:36.777892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:36.778602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:36.779288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:36.798114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:36.799456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af74a3-fefd-4812-b002-d764d2c085d3 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:36.812894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1138/2323] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:37.809317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:37.813629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:37.828670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c60d3-2165-4a27-81eb-649103db6984 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:37.834863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:37.836324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:37.838799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:37.839702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] PATH_INFO: `/v3/users/a36b47557ab74117bfce42df9acf2677` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:37.842897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36b47557ab74117bfce42df9acf2677)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:37.847388 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:37.928363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36b47557ab74117bfce42df9acf2677'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:37.929130 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36b47557ab74117bfce42df9acf2677'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:37.958621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36b47557ab74117bfce42df9acf2677'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:37.974691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36b47557ab74117bfce42df9acf2677'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:37.975537 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36b47557ab74117bfce42df9acf2677'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:37.989756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:38.006653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1186/2324] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:37 2022] DELETE /identity/v3/users/a36b47557ab74117bfce42df9acf2677 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:38.008748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:38.009271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:38.009271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:38.037420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:38.039426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:38.135751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:38.149525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1139/2325] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:38.161962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:38.164083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:38.248476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff79e7-3565-4222-868c-674d3c9d83c7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:38.253750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:38.254577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:38.254854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:38.255122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:38.266339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:38.267451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f3ce5-7647-4878-acf5-f5cfbec53118 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:38.279582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1187/2326] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:39.030229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.031744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:39.045808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616f7d1-a245-44d6-aea8-d27a4fc934e0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.057548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.058223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.058501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.058777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] PATH_INFO: `/v3/projects/c43f5e34819c4cd592c3dcf94ff90283` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.060336 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43f5e34819c4cd592c3dcf94ff90283)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.062457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.145260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43f5e34819c4cd592c3dcf94ff90283', 'request_id': 'req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:39.155493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43f5e34819c4cd592c3dcf94ff90283', 'request_id': 'req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:39.163387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43f5e34819c4cd592c3dcf94ff90283', 'request_id': 'req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:39.179720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] The token cache is being invalidate because project c43f5e34819c4cd592c3dcf94ff90283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:39.180028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:39.180758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f347e7d6-7b3c-4f5b-aad7-c25e502db7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:39.182352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1140/2327] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:39 2022] DELETE /identity/v3/projects/c43f5e34819c4cd592c3dcf94ff90283 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:39.187564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.188090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.188090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.208315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:39.209556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:39.291811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1188/2328] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:39.301973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.302270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.302769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.327106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:39.328346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:39.336678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1141/2329] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:39.341640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.352213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25239e49-6aa7-430c-b323-883cc1f7f6f2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.357660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.358269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.358634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.358998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.359844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:39.360219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.362657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.376686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1189/2330] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:39.381087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.392010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752fd4d-75e9-4475-8e9c-5beb0b5e6d6e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.406909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.407733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.408120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.408493 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.409475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.411515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.481642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1142/2331] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:39 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:39.485754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.506674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dbe05-2be1-4016-b96b-c57a11fdcedc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.594639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.595635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.596354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.596832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.597842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.599780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.630171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1190/2332] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:39 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:39.635496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.649912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec79f-89f4-4fa6-a64c-9daa66d4fe68 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.656013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.656748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.657239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.657580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.658603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.661149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.685342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1143/2333] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:39.689952 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.714286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094231b4-d96a-4515-98d8-2bde34ca8289 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.719698 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.720348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.720607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.720954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.721875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.723367 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99fbc4-f901-4114-9ba3-cbdcd27cf4b3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.736733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1191/2334] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:39.741788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.755976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad88aae-7c2f-4cde-b622-2e5caa3f4894 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:39.767341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:39.768100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.768377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.768691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] PATH_INFO: `/v3/projects/ea8a6f89c8184cf6ad87b7d2cef74a42/users/ece831f84da444ac9d54ce4af0642469/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.786956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8a6f89c8184cf6ad87b7d2cef74a42, user_id=ece831f84da444ac9d54ce4af0642469, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:39.789522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:39.808721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1144/2335] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:39 2022] PUT /identity/v3/projects/ea8a6f89c8184cf6ad87b7d2cef74a42/users/ece831f84da444ac9d54ce4af0642469/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:39.818173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:39.818463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:39.818794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:39.827927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:39.850617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] MFA Rules not processed for user `ece831f84da444ac9d54ce4af0642469`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:39.851712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:39.949538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1192/2336] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:39.962091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:39.967285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:40.084012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080355-2d7f-40ef-9288-0713692ec5ff admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:40.106926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:40.107839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:40.108272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:40.108769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:40.119614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:40.122105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999052-b37f-40da-ba98-35689c78eb7b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:40.156502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1145/2337] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:42.540528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:42.542330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:42.644687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd7fe6-598f-4577-a59f-6b964186f909 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:42.649402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:42.650060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:42.650341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:42.650614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] PATH_INFO: `/v3/users/501136f66e1a405c9a2c42dbe000a993` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:42.652137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=501136f66e1a405c9a2c42dbe000a993)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:42.655341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:42.727669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501136f66e1a405c9a2c42dbe000a993'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:42.728426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501136f66e1a405c9a2c42dbe000a993'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:42.746301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501136f66e1a405c9a2c42dbe000a993'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:42.753722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501136f66e1a405c9a2c42dbe000a993'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:42.754634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-31cb5a14-3e96-4b0e-a7f4-58ed38c49352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501136f66e1a405c9a2c42dbe000a993'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:42.777176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1193/2338] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:13:42 2022] DELETE /identity/v3/users/501136f66e1a405c9a2c42dbe000a993 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:42.780452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:42.780896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:42.781191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:42.822554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:42.822554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:42.824659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:42.826204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:42.826479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:42.843335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:42.867899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:42.873513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] MFA Rules not processed for user `4512745d3df04222851af1683753574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:42.875046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:42.934147 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1146/2339] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:42.939226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:42.941015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:42.962541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1194/2340] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:42.967885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:42.969238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:42.983333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c135c1f-066e-4de7-9ca8-5fb25d27402b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:42.988735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:42.989601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:42.990288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:42.990288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:42.991118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:42.993076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.005455 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef990a-c358-4ab6-918c-e1a63eb24653 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.009068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.009756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.010037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.010377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.020167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.021632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.023483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1195/2341] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:42 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:43.027387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.031775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1147/2342] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:13:43.102449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3f4e3-2162-485d-8ad9-5801fc95d195 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.108825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.109467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.109778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.110078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.111057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.113040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.139711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1196/2343] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:43 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:43.143949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.154663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db598608-cb81-420c-b0f8-40c9b287c2ae service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.159598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.160275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.160555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.161256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.161760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.163415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.176683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1148/2344] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:43.179358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.189795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066551e-37fa-4210-bd60-5760998d5c23 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.197280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.197971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.198253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.198523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] PATH_INFO: `/v3/projects/f13164ba31a44f8bb7890513517a5cfa/users/c8f6719ac3e84449b3c64aa684213c10/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.217774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13164ba31a44f8bb7890513517a5cfa, user_id=c8f6719ac3e84449b3c64aa684213c10, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.220438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.235086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1197/2345] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:43 2022] PUT /identity/v3/projects/f13164ba31a44f8bb7890513517a5cfa/users/c8f6719ac3e84449b3c64aa684213c10/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:43.239331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.249978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d758b72-39ae-44f6-b328-471fa013e8d6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.315663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.316417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.317276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.317931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.318733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.321816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.335428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.337798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:43.362857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1149/2346] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:43.370659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.384090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032debf-f15f-461e-8893-319f533f7795 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.392718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.394015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.394447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.394878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] PATH_INFO: `/v3/projects/135bf7ffddf64067a46fa88b1902a725` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.395261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5b285-ebfc-4035-8698-9af5578b7e23 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.397649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135bf7ffddf64067a46fa88b1902a725)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.400334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.401724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.402424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.402704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.402974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] PATH_INFO: `/v3/projects/f13164ba31a44f8bb7890513517a5cfa/users/c8f6719ac3e84449b3c64aa684213c10/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.406269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13164ba31a44f8bb7890513517a5cfa, user_id=c8f6719ac3e84449b3c64aa684213c10, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.409168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519b387-a429-4cfe-9d19-3e87ba422b61 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.423780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1150/2347] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:43 2022] PUT /identity/v3/projects/f13164ba31a44f8bb7890513517a5cfa/users/c8f6719ac3e84449b3c64aa684213c10/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:43.467687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:43.477558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135bf7ffddf64067a46fa88b1902a725', 'request_id': 'req-0b88f6e6-17ce-4419-9592-7b5013f37c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:43.486294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135bf7ffddf64067a46fa88b1902a725', 'request_id': 'req-0b88f6e6-17ce-4419-9592-7b5013f37c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:43.494943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135bf7ffddf64067a46fa88b1902a725', 'request_id': 'req-0b88f6e6-17ce-4419-9592-7b5013f37c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:43.512322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] The token cache is being invalidate because project 135bf7ffddf64067a46fa88b1902a725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:13:43.512580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:43.513402 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b88f6e6-17ce-4419-9592-7b5013f37c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:13:43.517370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1198/2348] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:13:43 2022] DELETE /identity/v3/projects/135bf7ffddf64067a46fa88b1902a725 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:43.524908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.524908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.525120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.563117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:43.564313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:43.615387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:43.685801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.686595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.686678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1151/2349] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:43.686763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.711977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:43.713742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:43.736929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1199/2350] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:43.738578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.757711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86da2-c1a4-4df1-a404-f95daa9f061a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.763603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.764340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.764729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.765634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.766531 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:13:43.766904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.768731 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.790410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.790726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1152/2351] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:13:43.812331 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9172a7-f362-4c65-9e83-0403bad2f0ed None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:43.823841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:43.825645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:43.826028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:43.826400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:43.827271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:43.829729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:43.878799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1200/2352] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:43 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:43.883394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:43.898473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9a3e-fb13-4287-96c7-01ca2cbdf33b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:44.017545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:44.017972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.018416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.018591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.020070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:44.023125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:44.061840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1153/2353] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:43 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:44.066086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:44.079968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8780-3077-4155-b221-c0df3f69ce6f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:44.088898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:44.090143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.090591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.091210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.092720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:44.094635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:44.108907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1201/2354] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:44.112570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:44.123625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a694-7be7-480e-a45c-c81409cc9c31 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:44.128627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:44.129298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.129584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.129861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.130565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:44.132252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17f45-da5d-4068-a67d-0f3c33879879 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:44.149673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:44.150728 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1154/2355] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:44.163417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540fc8-362a-43c3-8f46-a1f1b2c4b40b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:44.170420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:44.171191 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.171476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.171753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] PATH_INFO: `/v3/projects/2ad1ce79710b40b3a2e81b807b515da5/users/7fb23506b562457395d4cb005ba47fde/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.190311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad1ce79710b40b3a2e81b807b515da5, user_id=7fb23506b562457395d4cb005ba47fde, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:44.193413 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:44.215849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1202/2356] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:44 2022] PUT /identity/v3/projects/2ad1ce79710b40b3a2e81b807b515da5/users/7fb23506b562457395d4cb005ba47fde/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:44.221489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe58cc-665e-4304-a57f-782648a19aed None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.222003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe58cc-665e-4304-a57f-782648a19aed None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.222902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe58cc-665e-4304-a57f-782648a19aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.268288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-79fe58cc-665e-4304-a57f-782648a19aed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:44.269568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-79fe58cc-665e-4304-a57f-782648a19aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:44.355324 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1155/2357] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:44.367235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:44.369154 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:44.467814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5902cf-3a36-4ff3-8789-5380fd69c7ca admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:44.472382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:44.473714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:44.474151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:44.474622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:44.486548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:44.488616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:44.501516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1203/2358] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:49.926973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c070-25ca-4d80-848c-95c0a56c8672 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:49.927557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c070-25ca-4d80-848c-95c0a56c8672 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:49.927557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c070-25ca-4d80-848c-95c0a56c8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:49.972384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b9d1c070-25ca-4d80-848c-95c0a56c8672 None None] MFA Rules not processed for user `c8f6719ac3e84449b3c64aa684213c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:49.973678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b9d1c070-25ca-4d80-848c-95c0a56c8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:50.017875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:50.145121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1156/2359] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:50.331673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:50.333259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:50.574171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58892d-86b9-4e96-8e24-b6b79a540a01 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:50.590149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:50.591242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:50.591703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:50.592129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:50.595653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:50.603610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:50.689950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:50.691511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada306c3-9e3c-4e30-be1e-78a78be492a7 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:50.729729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1204/2360] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:53.391589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:53.392310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:53.392310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:53.447435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] MFA Rules not processed for user `4512745d3df04222851af1683753574f`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:53.451909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:53.495308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1157/2361] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:13:53.725465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdcc4-9cd4-464c-b919-97254ab2b9d7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:53.726372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdcc4-9cd4-464c-b919-97254ab2b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:53.726821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cdcc4-9cd4-464c-b919-97254ab2b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:53.764365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cb0cdcc4-9cd4-464c-b919-97254ab2b9d7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:53.766608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb0cdcc4-9cd4-464c-b919-97254ab2b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:53.778246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1205/2362] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:53.801122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:53.802511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:53.827654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:53.827946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:53.828213 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:53.844381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32c13-084c-461c-831a-a7f89ec0d4df None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:53.865606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:53.867067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:53.867951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:53.873302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:53.876616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] MFA Rules not processed for user `7fb23506b562457395d4cb005ba47fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:53.880087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:53.898353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:53.902065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:53.924557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1158/2363] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:13:53.996568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1206/2364] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:53.997880 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.018946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5dac-1a66-4952-ba0a-20432df79eec service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.057964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.058967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.059975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.063510 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.065940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.068020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.133902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1159/2365] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:13:53 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:13:54.138140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.154855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751e6cf-c4e7-43f4-8159-0a2ce90e1d55 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.274034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.274661 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.275092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.275409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.276183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.278240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.334544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1207/2366] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:13:54 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:13:54.335277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.350387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2a12-b801-4f57-902b-29d5c1ac0111 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.362322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.362961 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.363333 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.363610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.364306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.370507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.397589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1160/2367] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:13:54.399338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.411248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27a992-fca1-4e3f-9e1c-485deeb298f7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.419335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.420300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.420937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.421415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] PATH_INFO: `/v3/projects/d9e1089a665a45b18aeebc03b1cac95a/users/eaee37cf5a0f4d128231bd35e0d2a404/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.439908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e1089a665a45b18aeebc03b1cac95a, user_id=eaee37cf5a0f4d128231bd35e0d2a404, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.444160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.447878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:13:54.463422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1208/2368] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:54 2022] PUT /identity/v3/projects/d9e1089a665a45b18aeebc03b1cac95a/users/eaee37cf5a0f4d128231bd35e0d2a404/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:13:54.467388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.480158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc2906-0077-4d8b-9cbc-fb1b349aa785 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.559724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.560364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.560658 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.560949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.562286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.564143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a0bda-091d-4b53-9b8a-b12079d49f97 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.578622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1161/2369] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:13:54.582494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:54.603243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeef99-d12f-4153-b6e1-b0ca7caad184 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:54.609278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:54.609961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:54.610244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:54.610514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] PATH_INFO: `/v3/projects/d9e1089a665a45b18aeebc03b1cac95a/users/eaee37cf5a0f4d128231bd35e0d2a404/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:54.628986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e1089a665a45b18aeebc03b1cac95a, user_id=eaee37cf5a0f4d128231bd35e0d2a404, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:54.634294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:54.662489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1209/2370] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:13:54 2022] PUT /identity/v3/projects/d9e1089a665a45b18aeebc03b1cac95a/users/eaee37cf5a0f4d128231bd35e0d2a404/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:13:58.063748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bbe4c-cce7-4be2-97c3-b357c1596699 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:58.064328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bbe4c-cce7-4be2-97c3-b357c1596699 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:58.064328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bbe4c-cce7-4be2-97c3-b357c1596699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:58.108505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-474bbe4c-cce7-4be2-97c3-b357c1596699 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:13:58.111856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-474bbe4c-cce7-4be2-97c3-b357c1596699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:13:58.249608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1162/2371] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:13:58.272418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:13:58.497459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e1c54-02a2-473e-8ce0-1be30386f2f7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:13:58.503576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:13:58.505314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:13:58.505602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:13:58.507966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:13:58.537128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:13:58.538755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924783-dfb0-4475-bcfe-385eacb0d188 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:13:58.563810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1210/2372] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:00.525470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:00.525986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:00.526067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:00.550779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:00.564957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] MFA Rules not processed for user `eaee37cf5a0f4d128231bd35e0d2a404`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:00.568741 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:00.656853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1163/2373] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:14:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:03.438848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d023-70a4-41c9-94bd-3d1f8bc627b7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:03.439872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d023-70a4-41c9-94bd-3d1f8bc627b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:03.440329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d023-70a4-41c9-94bd-3d1f8bc627b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:03.463814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3ab0d023-70a4-41c9-94bd-3d1f8bc627b7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:03.465297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3ab0d023-70a4-41c9-94bd-3d1f8bc627b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:03.481497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1211/2374] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:03.504426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:03.518643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b9764-8b34-4924-bd85-53f5e37d6654 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:03.525102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:03.525742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:03.526022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:03.526486 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:03.536602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:03.538857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:03.550862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1164/2375] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:08.630011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:08.630639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:08.630639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:08.651978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:08.653478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:08.661950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1212/2376] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:08.686505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:08.699456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820f474-92e5-49e6-be85-73a2752623bd service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:08.706037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:08.707071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:08.707528 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:08.708110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:08.721464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:08.723393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afe1b5-efbc-4d8a-99ee-2086f1b12bb4 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:08.734305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1165/2377] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:10.663161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:10.664550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:10.725124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d00c5-0a07-4391-be70-c5b6c8c217e1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:10.729111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:10.729781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:10.730113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:10.730488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:10.792450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:10.793928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:10.803337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1213/2378] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:10.951415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8d879-e86c-4dbd-a854-5db3ba650ae1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:10.951943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8d879-e86c-4dbd-a854-5db3ba650ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:10.951943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8d879-e86c-4dbd-a854-5db3ba650ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:10.972743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b2a8d879-e86c-4dbd-a854-5db3ba650ae1 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:10.973949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b2a8d879-e86c-4dbd-a854-5db3ba650ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:11.033558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1166/2379] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:11.079903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:11.081485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:11.096219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:11.166562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6f370-617f-4df0-bde7-80ba4ccbe497 service glance] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:11.172524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:11.173345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:11.173622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:11.173888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:11.183719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:11.186316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:11.196982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1214/2380] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:14:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:14:14.303458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f2e-0419-4163-8639-732a9dc62740 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:14.311345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f2e-0419-4163-8639-732a9dc62740 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:14.311816 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f2e-0419-4163-8639-732a9dc62740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:14.350372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-feac9f2e-0419-4163-8639-732a9dc62740 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:14.353440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-feac9f2e-0419-4163-8639-732a9dc62740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:14.366146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1167/2381] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:14:14.502617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:14.516124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8816e3a-6ec1-49f5-9d8f-2567f6ba5f97 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:14.530683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:14.532270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:14.532270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:14.532606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:14.546192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:14.548032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fbd04-61be-4136-bae7-0425ef737371 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:14.561433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1215/2382] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:19.744055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:19.744968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:19.744968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:19.766853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] MFA Rules not processed for user `7fb23506b562457395d4cb005ba47fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:19.768072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:19.775179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1168/2383] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:14:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:14:20.333535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185037ed-637c-4dd6-b94f-889a57b936ed None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:20.334111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185037ed-637c-4dd6-b94f-889a57b936ed None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:20.334111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185037ed-637c-4dd6-b94f-889a57b936ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:20.356303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-185037ed-637c-4dd6-b94f-889a57b936ed None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:20.358333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-185037ed-637c-4dd6-b94f-889a57b936ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:20.366501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1216/2384] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:20.434159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:20.454775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b2f30-cb60-4893-b9a9-bbad7cf75468 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:20.460051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:20.460958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:20.462887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:20.462887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:20.474496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:20.475879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:20.489904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1169/2385] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:24.020863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:24.021294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:24.021459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:24.042536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:24.043817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:24.051561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1217/2386] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:14:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:24.067087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:24.079153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef30f-482d-4656-b6b2-3e48c94870b9 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:24.088760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:24.089395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:24.089673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:24.089946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:24.100924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:24.102525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bcc5f-839d-44fa-8524-8988ce3addb0 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:24.111933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1170/2387] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:14:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:14:34.036834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=41 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:34.108408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:34.261566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:34.262967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:34.276970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138cd32-cd64-4dd8-b2a1-4629e7632e80 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:34.282415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:34.283035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:34.283321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:34.283573 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] PATH_INFO: `/v3/users/ece831f84da444ac9d54ce4af0642469` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:34.284746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece831f84da444ac9d54ce4af0642469)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:34.286617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:34.332175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece831f84da444ac9d54ce4af0642469'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.332853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece831f84da444ac9d54ce4af0642469'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.345554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece831f84da444ac9d54ce4af0642469'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.352798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece831f84da444ac9d54ce4af0642469'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.353417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece831f84da444ac9d54ce4af0642469'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.365450 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1218/2388] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:14:34 2022] DELETE /identity/v3/users/ece831f84da444ac9d54ce4af0642469 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:14:34.369872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5657-1770-4b22-ac78-93b30926163a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:34.370161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5657-1770-4b22-ac78-93b30926163a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:34.370438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e5657-1770-4b22-ac78-93b30926163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:34.390815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-393e5657-1770-4b22-ac78-93b30926163a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:34.392292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-393e5657-1770-4b22-ac78-93b30926163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:34.453168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1171/2389] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:34.462821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:34.464385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:34.524076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe11dd-7ad2-47d3-8a91-30bd1062aa5f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:34.527735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:34.528727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:34.529074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:34.529409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:34.540420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:34.542295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9197-7b2c-4b73-bddb-1545447005e8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:34.552694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1219/2390] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:14:34.827918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e5657-1770-4b22-ac78-93b30926163a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:34.829425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-393e5657-1770-4b22-ac78-93b30926163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:34.844726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e5657-1770-4b22-ac78-93b30926163a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:34.849472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:34.850124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:34.851008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:34.851291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] PATH_INFO: `/v3/projects/ea8a6f89c8184cf6ad87b7d2cef74a42` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:34.852456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8a6f89c8184cf6ad87b7d2cef74a42)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:34.854393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:34.901814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8a6f89c8184cf6ad87b7d2cef74a42', 'request_id': 'req-31bd5866-9fc8-41f7-a445-079149de1ec3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.907793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8a6f89c8184cf6ad87b7d2cef74a42', 'request_id': 'req-31bd5866-9fc8-41f7-a445-079149de1ec3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.913577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8a6f89c8184cf6ad87b7d2cef74a42', 'request_id': 'req-31bd5866-9fc8-41f7-a445-079149de1ec3'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.926416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] The token cache is being invalidate because project ea8a6f89c8184cf6ad87b7d2cef74a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:14:34.926697 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.927301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:14:34.929013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1172/2391] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:14:34 2022] DELETE /identity/v3/projects/ea8a6f89c8184cf6ad87b7d2cef74a42 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:14:44.548084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:44.923182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:14:56.814708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:56.815237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:56.815237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:56.835675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] MFA Rules not processed for user `57718594421249669c863c1f8d97830f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:14:56.836928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:56.911510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1220/2392] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:14:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:14:59.267931 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:14:59.270053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:59.359280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd5866-9fc8-41f7-a445-079149de1ec3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:14:59.365242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:14:59.365780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:14:59.366076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:14:59.366332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:14:59.368304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:14:59.381784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:14:59.385030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:14:59.397272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1173/2393] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:14:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:06.291165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:06.292668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:06.369832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8cb9f-8a30-4fe0-98c0-c336c1892f47 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:06.374734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:06.375457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:06.375754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:06.376000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:06.378311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:06.447758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:06.449329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef7d2e-bf89-4cbf-9c6c-06f0972c6f07 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:06.459549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1221/2394] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:06.891761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:06.893805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:06.905310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5f00-9c62-4313-9be6-e966f0061745 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:06.908949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:06.909565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:06.909843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:06.910132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:06.911933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:06.978062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:06.979535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ac6a9-7b8f-4e7c-9476-9a942a46d530 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:06.993502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1174/2395] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:12.022164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:12.022660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:12.022761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:12.062421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] MFA Rules not processed for user `036691cad2d94644b594624f4eb957b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:12.067011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:12.180967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:15:12.203363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1222/2396] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:15:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:16.985441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=62 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:15:18.910307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493d22-77a8-4f47-80ce-4a040817727d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:18.910944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493d22-77a8-4f47-80ce-4a040817727d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:18.910944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493d22-77a8-4f47-80ce-4a040817727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:18.935570 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d7493d22-77a8-4f47-80ce-4a040817727d None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:18.937448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d7493d22-77a8-4f47-80ce-4a040817727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:19.003981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1175/2397] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:19.033233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:19.034979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:19.116583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb357f-408a-4f4f-9d2a-66678cdf0651 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:19.121921 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:19.122546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:19.122820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:19.123353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:19.132730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:19.134353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:19.142384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1223/2398] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:15:28.996032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=25 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:15:29.139145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=32 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:15:31.837537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64e94-48ef-4990-97f5-ff1c1aa0d3c3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:31.838148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64e94-48ef-4990-97f5-ff1c1aa0d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:31.838148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d64e94-48ef-4990-97f5-ff1c1aa0d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:31.857036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-54d64e94-48ef-4990-97f5-ff1c1aa0d3c3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:31.858253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-54d64e94-48ef-4990-97f5-ff1c1aa0d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:31.916872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1176/2399] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:31.939250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:31.940766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:32.013011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ded6a-0df2-401b-bf94-1b489caba426 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:32.018565 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:32.019171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:32.019447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:32.019716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:32.027675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:32.029280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:32.038794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1224/2400] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:38.213024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdcc2-436a-42be-9088-ffc237eb6a4a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:38.213542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdcc2-436a-42be-9088-ffc237eb6a4a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:38.213542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cdcc2-436a-42be-9088-ffc237eb6a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:38.233255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c79cdcc2-436a-42be-9088-ffc237eb6a4a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:38.234596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c79cdcc2-436a-42be-9088-ffc237eb6a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:38.242364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1177/2401] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:38.265026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:38.276410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aebf9b-9fee-407f-ac96-6e7b1d8008ff service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:38.282390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:38.282988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:38.283265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:38.283527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:38.291427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:38.293017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644659a7-4506-4725-8ea4-a83a298d6810 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:38.302352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1225/2402] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:41.761925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265db47-084a-4858-9c72-a164ac862702 None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:41.763257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265db47-084a-4858-9c72-a164ac862702 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:41.763755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265db47-084a-4858-9c72-a164ac862702 None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:41.765598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1178/2403] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:15:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:15:41.774254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d785-32e2-4e23-a548-74eeef0f49c9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:41.774854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d785-32e2-4e23-a548-74eeef0f49c9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:41.774854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d785-32e2-4e23-a548-74eeef0f49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:41.801577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1507d785-32e2-4e23-a548-74eeef0f49c9 None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:41.803118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1507d785-32e2-4e23-a548-74eeef0f49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:41.816599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1226/2404] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:15:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:41.830458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265db47-084a-4858-9c72-a164ac862702 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:41.833755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9265db47-084a-4858-9c72-a164ac862702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:41.901611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265db47-084a-4858-9c72-a164ac862702 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:41.905397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:41.906023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:41.906305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:41.907152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:41.917606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:41.919027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be54c93-6eda-4b88-8f53-e03337225f60 service glance] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:41.929710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1179/2405] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:15:42.005216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7d73-246b-4ff6-ab7e-a3092171a8e7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.005499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7d73-246b-4ff6-ab7e-a3092171a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.005806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7d73-246b-4ff6-ab7e-a3092171a8e7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.007165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1227/2406] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 06:15:42.011907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad523-301b-43fc-baf4-6890498bde8b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.012194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad523-301b-43fc-baf4-6890498bde8b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.012469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad523-301b-43fc-baf4-6890498bde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.033829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1f4ad523-301b-43fc-baf4-6890498bde8b None None] MFA Rules not processed for user `f022f8a1b5364341b0a0cdeaf7bc16e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:42.035026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1f4ad523-301b-43fc-baf4-6890498bde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:42.042734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1180/2407] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:15:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:42.058893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc7d73-246b-4ff6-ab7e-a3092171a8e7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:42.071292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc7d73-246b-4ff6-ab7e-a3092171a8e7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:42.074758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:42.075357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.075745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.076018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.084371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:42.085905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0228-a7bb-48c7-ba40-7dfcf3d4604a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:42.094870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1228/2408] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:42.175751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79dae-59d9-4cbe-8c41-c52f8a1bac7d None None] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.176036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79dae-59d9-4cbe-8c41-c52f8a1bac7d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.176308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e79dae-59d9-4cbe-8c41-c52f8a1bac7d None None] PATH_INFO: `/` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.177705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1181/2409] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jul 28 06:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 06:15:42.183378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809c95-d145-4e31-9801-2c1a04d4bc9a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.183668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809c95-d145-4e31-9801-2c1a04d4bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.183975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809c95-d145-4e31-9801-2c1a04d4bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.204282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-50809c95-d145-4e31-9801-2c1a04d4bc9a None None] MFA Rules not processed for user `b65b1e894e3d4d2eb08b7cddfeff1822`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:42.205516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-50809c95-d145-4e31-9801-2c1a04d4bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:42.215077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1229/2410] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jul 28 06:15:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:42.225495 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e79dae-59d9-4cbe-8c41-c52f8a1bac7d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:42.236483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e79dae-59d9-4cbe-8c41-c52f8a1bac7d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:42.239963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:42.240555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:42.240856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:42.241125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:42.251394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:42.252914 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:42.263286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1182/2411] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:43.367756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996bae3-ad20-47d9-94e8-b4df709ba999 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:43.368503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996bae3-ad20-47d9-94e8-b4df709ba999 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:43.368815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996bae3-ad20-47d9-94e8-b4df709ba999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:43.389040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3996bae3-ad20-47d9-94e8-b4df709ba999 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:43.390285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3996bae3-ad20-47d9-94e8-b4df709ba999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:43.399516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1230/2412] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:43.421014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:43.432242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32ec2f-ed11-4515-a9e5-176f62d89426 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:43.438652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:43.439266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:43.439548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:43.439821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:43.448457 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:43.450657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:43.461090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1183/2413] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:46.999458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f174-7d65-49f9-9362-502a53f97c69 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:46.999849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f174-7d65-49f9-9362-502a53f97c69 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:47.000566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f174-7d65-49f9-9362-502a53f97c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:47.019544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52c8f174-7d65-49f9-9362-502a53f97c69 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:47.020781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52c8f174-7d65-49f9-9362-502a53f97c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:47.027858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1231/2414] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:15:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:47.039797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:47.051422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e6187-ad67-4fc6-87e8-120ba9f012af service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:47.057384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:47.058015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:47.058286 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:47.058742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:47.068235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:47.069969 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:47.078983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1184/2415] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:15:48.600731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2072c-61a5-43af-a424-fe8b1be92190 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:48.601276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2072c-61a5-43af-a424-fe8b1be92190 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:48.601276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2072c-61a5-43af-a424-fe8b1be92190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:48.626605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fef2072c-61a5-43af-a424-fe8b1be92190 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:15:48.627408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fef2072c-61a5-43af-a424-fe8b1be92190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:48.635297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1232/2416] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:15:48.667582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:15:48.669199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:15:48.685838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7316178-1759-4a07-a462-a14d703616f5 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:15:48.692428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:15:48.693094 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:15:48.693387 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:15:48.693641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:15:48.702429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:15:48.704002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:15:48.713589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1185/2417] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:15:58.620078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=61 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:15:58.709208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=83 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:16:15.425541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bce9-393f-46ae-8dbd-dffbd8108639 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:15.426120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bce9-393f-46ae-8dbd-dffbd8108639 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:15.426120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bce9-393f-46ae-8dbd-dffbd8108639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:15.445559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-43c1bce9-393f-46ae-8dbd-dffbd8108639 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:16:15.446847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43c1bce9-393f-46ae-8dbd-dffbd8108639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:15.454685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1233/2418] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:16:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:16:15.468059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:15.480824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fb1d-6b2a-44e1-a418-8d9088e1262a service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:15.486403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:15.487249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:15.487534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:15.487808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:15.496206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:15.497811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:15.505938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1186/2419] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:16:16.599163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:16.599709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:16.599709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:16.621349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:16:16.622542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:16.630272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1234/2420] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 28 06:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:16:16.655778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:16.668065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2794b-d589-4dc9-8929-c1bbf9202f65 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:16.673475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:16.674611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:16.674885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:16.675156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:16.683264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:16.684852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:16.694172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1187/2421] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:16:26.616215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:16:26.690577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=12 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:16:48.946522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:48.947994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:48.961163 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c285-4445-4aac-9288-1cdc2143f4dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:48.966707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:48.967385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:48.967544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:48.967815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] PATH_INFO: `/v3/users/57718594421249669c863c1f8d97830f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:48.969458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57718594421249669c863c1f8d97830f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:48.973528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:49.025195 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57718594421249669c863c1f8d97830f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.025860 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57718594421249669c863c1f8d97830f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.037841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57718594421249669c863c1f8d97830f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.045979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57718594421249669c863c1f8d97830f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.046673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57718594421249669c863c1f8d97830f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.061232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1235/2422] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:16:48 2022] DELETE /identity/v3/users/57718594421249669c863c1f8d97830f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:16:49.243555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:49.256153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86c76f-6d42-4a3f-b2ba-044be31854d8 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:49.322400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:49.323059 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:49.324261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:49.324261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] PATH_INFO: `/v3/projects/d610b083631b4783b9e6a1fb7386048d` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:49.326090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d610b083631b4783b9e6a1fb7386048d)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:49.326834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:49.375859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd610b083631b4783b9e6a1fb7386048d', 'request_id': 'req-e32e1f4e-0328-47c3-828d-fdde78c28c3d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.382798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd610b083631b4783b9e6a1fb7386048d', 'request_id': 'req-e32e1f4e-0328-47c3-828d-fdde78c28c3d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.388424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd610b083631b4783b9e6a1fb7386048d', 'request_id': 'req-e32e1f4e-0328-47c3-828d-fdde78c28c3d'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.401803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] The token cache is being invalidate because project d610b083631b4783b9e6a1fb7386048d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:16:49.402089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.402706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:16:49.404221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1188/2423] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:16:49 2022] DELETE /identity/v3/projects/d610b083631b4783b9e6a1fb7386048d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:16:55.415428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:55.416876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:55.475007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1ab4b-761e-493e-b759-4162b1a62cc8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:55.523310 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:55.523914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:55.524228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:55.524466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:55.526286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:55.567975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:16:55.598069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:55.599535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:55.610442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1236/2424] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:16:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:16:56.809501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:16:56.811045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:56.823930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e1f4e-0328-47c3-828d-fdde78c28c3d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:16:56.827435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:16:56.828043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:16:56.828319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:16:56.828586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:16:56.830316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:16:56.845109 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:16:56.847424 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:16:56.859104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1189/2425] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:16:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:05.605627 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=14 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:06.854042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:09.128956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:09.130370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:09.144715 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924b4fe-baba-4c75-866e-9f2e190f64a4 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:09.150133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:09.150739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:09.151020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:09.151294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:09.153018 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:09.211357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:09.213230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:09.222236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1237/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:19.218049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=28 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:24.840751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:24.851775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61aa-2942-43d3-8637-4072408ae367 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:24.857170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:24.858044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:24.858309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:24.859123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:24.860371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:24.871661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:24.873670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:24.883164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1190/2427] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:33.916555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:33.928231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199a9f7-9040-4465-95a3-ae9457634b08 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:33.934425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:33.935039 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:33.935305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:33.935578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:33.937317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:33.998135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:33.999723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1d89-26c9-493f-934a-0c30d7c6caca service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:34.008984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1238/2428] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:34.879522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:38.812530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:38.830615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cd6f-806a-4958-aeef-284e54619c94 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:38.836678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:38.837732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:38.838257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:38.838613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:38.840752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:38.855085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:38.857040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:38.869003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1191/2429] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:42.069153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:42.069756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:42.069756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:42.099523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] MFA Rules not processed for user `0db6c2215b304cb3af3aebc565d55278`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:17:42.101435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:42.108614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1239/2430] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:17:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:17:42.441537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:42.451378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad384b58-4fe6-46a2-8517-76923d48590d service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:42.455132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:42.455677 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:42.455956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:42.456229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:42.458081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:42.468367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:42.469810 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e1428-9f86-4832-9e7c-517d01424e84 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:42.477725 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1192/2431] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:42.787460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:42.788971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:42.862153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c557ceb-31fa-4710-8b6c-9fc343eb04ec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:42.867069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:42.867684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:42.867963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:42.868236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:42.870666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:42.882207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:42.883781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:42.893705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1240/2432] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:17:46.783686 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:46.784233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:46.784233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:46.803651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] MFA Rules not processed for user `036691cad2d94644b594624f4eb957b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:17:46.804866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:46.867747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1193/2433] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:17:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:17:52.889514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=63 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:56.856995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=37 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:17:57.774063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:17:57.788286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40ed3a-d59e-4898-b286-3520286b060a service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:17:57.793769 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:17:57.794520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:17:57.794803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:17:57.795076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:17:57.796878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:17:57.813153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:17:57.814718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb1ea-7a8c-4608-bfe5-6888ebe4f722 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:17:57.826735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1241/2434] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:17:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:18:01.912759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:01.914266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:01.929770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139becc6-a7ec-42ce-9cfb-47b57dc6cc5d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:01.935659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:01.936274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:01.936549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:01.936839 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:01.938832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:01.951392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:01.953071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:01.963902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1194/2435] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:18:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:18:07.821977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:11.960379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:25.969724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:25.970266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:25.970266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:25.989876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:25.991121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:26.045285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1242/2436] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:18:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:18:26.091808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:26.093250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:26.161384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee327e-79d9-4ed1-8283-4ae93acd1209 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:26.166386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:26.167028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:26.167307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:26.167609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:26.176468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:26.178084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:26.186104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1195/2437] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:18:29.941272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:29.942988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:29.965681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f54c7-260c-4458-8105-7b2e82e37bf7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:29.982073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:29.983351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:29.983837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:29.984353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:29.987777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:30.003852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:30.005635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:30.019183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1243/2438] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:18:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:18:33.391001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:33.392491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:33.458930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3133f0d-a7dc-4049-aa55-e11ccd0ecf47 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:33.463670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:33.464306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:33.464587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:33.464891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] PATH_INFO: `/v3/users/7fb23506b562457395d4cb005ba47fde` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:33.466028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb23506b562457395d4cb005ba47fde)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:33.467945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:33.513663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb23506b562457395d4cb005ba47fde'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.521128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb23506b562457395d4cb005ba47fde'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.521755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb23506b562457395d4cb005ba47fde'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.532300 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb23506b562457395d4cb005ba47fde'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.544454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb23506b562457395d4cb005ba47fde'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.550917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1196/2439] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:18:33 2022] DELETE /identity/v3/users/7fb23506b562457395d4cb005ba47fde => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:33.730551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:33.744350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79620-d411-48ae-8238-f7cfa0f3cfea service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:33.801516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:33.802146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:33.802419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:33.802685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] PATH_INFO: `/v3/projects/2ad1ce79710b40b3a2e81b807b515da5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:33.803809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad1ce79710b40b3a2e81b807b515da5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:33.805933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:33.851756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad1ce79710b40b3a2e81b807b515da5', 'request_id': 'req-d783fa75-ae16-4895-8c03-2675d72d0deb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.857762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad1ce79710b40b3a2e81b807b515da5', 'request_id': 'req-d783fa75-ae16-4895-8c03-2675d72d0deb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.863607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad1ce79710b40b3a2e81b807b515da5', 'request_id': 'req-d783fa75-ae16-4895-8c03-2675d72d0deb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.875335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] The token cache is being invalidate because project 2ad1ce79710b40b3a2e81b807b515da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:18:33.875614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.876291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:33.878137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1244/2440] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:18:33 2022] DELETE /identity/v3/projects/2ad1ce79710b40b3a2e81b807b515da5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:33.881965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:33.883366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:33.896956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6ec0-14ed-478c-a670-da272fa8f483 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:33.901478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:33.954254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:33.954897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:33.955177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:33.955450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] PATH_INFO: `/v3/users/eaee37cf5a0f4d128231bd35e0d2a404` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:33.956591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaee37cf5a0f4d128231bd35e0d2a404)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:33.958534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:34.003992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaee37cf5a0f4d128231bd35e0d2a404'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.012742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaee37cf5a0f4d128231bd35e0d2a404'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.013450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaee37cf5a0f4d128231bd35e0d2a404'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.022331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaee37cf5a0f4d128231bd35e0d2a404'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.035603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-8b46b5ec-15f7-4ed4-834d-f6fcc8c4f5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaee37cf5a0f4d128231bd35e0d2a404'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.041563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1197/2441] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:18:33 2022] DELETE /identity/v3/users/eaee37cf5a0f4d128231bd35e0d2a404 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:34.223219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:18:34.224802 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:34.237826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783fa75-ae16-4895-8c03-2675d72d0deb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:18:34.259076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:34.309990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:18:34.310702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:34.310983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:34.311259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] PATH_INFO: `/v3/projects/d9e1089a665a45b18aeebc03b1cac95a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:34.313003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e1089a665a45b18aeebc03b1cac95a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:18:34.314905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:18:34.362772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e1089a665a45b18aeebc03b1cac95a', 'request_id': 'req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.369590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e1089a665a45b18aeebc03b1cac95a', 'request_id': 'req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.375509 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e1089a665a45b18aeebc03b1cac95a', 'request_id': 'req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.395783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] The token cache is being invalidate because project d9e1089a665a45b18aeebc03b1cac95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:18:34.396076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.396738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:18:34.398267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1245/2442] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:18:34 2022] DELETE /identity/v3/projects/d9e1089a665a45b18aeebc03b1cac95a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:18:44.038045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:44.392890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:18:46.902369 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:18:46.902936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:18:46.902936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:18:46.922483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] MFA Rules not processed for user `343be19d43aa42a9a0ac7bb88b12e425`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:18:46.923657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:18:46.978311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1198/2443] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:18:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:18:56.971511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=25 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:09.556015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:09.557421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:09.616183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bad3-90e0-4471-a87f-9a100f0c0baa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:09.619706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:09.620320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:09.620599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:09.620898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:09.622651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:09.680824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:09.682240 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:09.691114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1246/2444] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:19.686975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=48 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:27.340738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:27.342162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:27.399754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d52803-5e43-4c1c-a5c7-ecbaf03b6a41 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:27.403192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:27.403807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:27.404089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:27.404366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:27.406803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:27.467228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:27.469308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:27.478907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1199/2445] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:30.663406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.665642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:30.684357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e508-a9ec-4752-ae25-2b4979a72f2f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:30.689487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:30.690119 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:30.690398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:30.690669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] PATH_INFO: `/v3/users/036691cad2d94644b594624f4eb957b9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:30.691812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=036691cad2d94644b594624f4eb957b9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:30.695146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:30.745549 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036691cad2d94644b594624f4eb957b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:30.746517 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036691cad2d94644b594624f4eb957b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:30.759299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036691cad2d94644b594624f4eb957b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:30.767781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036691cad2d94644b594624f4eb957b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:30.768393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ac84a3f7-36d7-4da2-9f43-47ffed4a5f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036691cad2d94644b594624f4eb957b9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:30.782548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1247/2446] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:30 2022] DELETE /identity/v3/users/036691cad2d94644b594624f4eb957b9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:30.975194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:30.988844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d258a-e679-4e1a-8495-5e3d63ee6434 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.048854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.049534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.049811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.050085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] PATH_INFO: `/v3/projects/a9563ec5f5a34babbed15a2b4469414b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.051226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9563ec5f5a34babbed15a2b4469414b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.053187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.117558 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9563ec5f5a34babbed15a2b4469414b', 'request_id': 'req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:31.120216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:31.126049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9563ec5f5a34babbed15a2b4469414b', 'request_id': 'req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:31.134377 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9563ec5f5a34babbed15a2b4469414b', 'request_id': 'req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:31.146999 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] The token cache is being invalidate because project a9563ec5f5a34babbed15a2b4469414b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:31.147285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:31.147955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d17569d8-86e7-4e2c-9cd4-d3e29f81b785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:31.149506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1200/2447] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:30 2022] DELETE /identity/v3/projects/a9563ec5f5a34babbed15a2b4469414b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:31.154435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.154730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.155037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.175295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:31.176507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:31.238210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1248/2448] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:31.250312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.250594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.250865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.271063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:31.272246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:31.280390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1201/2449] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:19:31.285214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.294855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f8877-8161-49e9-8ff1-e20c307bee79 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.299674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.300353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.300628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.300924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.301606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:31.301901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.303464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.315173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1249/2450] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:31.319736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.329559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaed07-a5fd-44ec-9c5b-2ecd35c2c826 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.334218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.334817 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.335090 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.335351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.335998 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.338213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.365223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1202/2451] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:31.369464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.379768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3eb9-9b2d-408c-9236-8c56de94f1d7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.441576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.442192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.442461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.442723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.443375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.445348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.454307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:31.471510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1250/2452] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:31.475696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.486704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc3227-9725-45d2-acd9-6e0b2efabb07 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.491204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.491813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.492086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.492351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.493067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.494630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.506532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1203/2453] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:31.509733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.521772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a305b5-83c6-41d0-a319-20271e706cce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.528171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.528936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.529319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.529595 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.530339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.532473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71198591-cdb4-4eaf-aafc-b8f21269f3be admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.543311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1251/2454] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:31.548567 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.558766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf35d-1902-4ffb-9c51-552f0e6bb171 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.563541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.564205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.564485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.564806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] PATH_INFO: `/v3/projects/fdfff8d5c8314425af07daa9b0d9dfd5/users/cea7e2a5f02748b5938b5e4df2c8e853/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.580239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfff8d5c8314425af07daa9b0d9dfd5, user_id=cea7e2a5f02748b5938b5e4df2c8e853, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.583278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.597787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1204/2455] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:31 2022] PUT /identity/v3/projects/fdfff8d5c8314425af07daa9b0d9dfd5/users/cea7e2a5f02748b5938b5e4df2c8e853/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:31.610069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.610352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.610620 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.638395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] MFA Rules not processed for user `cea7e2a5f02748b5938b5e4df2c8e853`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:31.639652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:31.719063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1252/2456] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:31.723304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.790038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacf309-984e-4d83-8e2f-9b3b70313d65 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.794869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.795480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.795752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.796018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.797270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.799178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.825050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1205/2457] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:31.829292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.839937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bd115-1d85-4c54-8494-1f98b33865b6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.896748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.897284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.897560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.897828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.898492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.900369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.921578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1253/2458] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:31 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:31.925547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.935717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35281-bc94-4239-9607-49181b09b75a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.940363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.941008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.941291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.941566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.942256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.943859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:31.955186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1206/2459] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:31.959206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:31.970488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010dba4-00a7-4ab8-b1bb-862001b545e5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:31.974998 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:31.975653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:31.975932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:31.976203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] PATH_INFO: `/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc/users/e894112dbcd94d4ca989b822ccc9b92e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:31.990911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca3d3c92d3f48059ff6582e06e086cc, user_id=e894112dbcd94d4ca989b822ccc9b92e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:31.993663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.006418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1254/2460] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:31 2022] PUT /identity/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc/users/e894112dbcd94d4ca989b822ccc9b92e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:32.010401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.021023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a809a0d-105a-4d19-8b74-81097d15581e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.067134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.079433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.080061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.080341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.080615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.081335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.082956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703c8f2-a79a-4362-9cce-050c8dac3c9d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.094299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1207/2461] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:32.098544 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.109758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356108f-14b0-43f0-abbe-59bd5ed72207 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.114416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.115080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.115358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.115629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] PATH_INFO: `/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc/users/e894112dbcd94d4ca989b822ccc9b92e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.117576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca3d3c92d3f48059ff6582e06e086cc, user_id=e894112dbcd94d4ca989b822ccc9b92e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.120182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.130442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1255/2462] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:32 2022] PUT /identity/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc/users/e894112dbcd94d4ca989b822ccc9b92e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:32.141257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.141543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.141819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.169494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] MFA Rules not processed for user `e894112dbcd94d4ca989b822ccc9b92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:32.170704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.238092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1208/2463] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:32.250155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.251932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.275126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.311519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd56e-7459-4517-985f-e7a0cb4c066e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.315856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.316482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.316789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.317064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.328210 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.333181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e18c2-29e3-4e3d-8aad-9aae7c909ff7 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.339327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1256/2464] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:32.725061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.794345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c414e05-1a12-4451-9f94-21b6117e5a33 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:32.799715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:32.800378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.800680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.800959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] PATH_INFO: `/v3/users/cea7e2a5f02748b5938b5e4df2c8e853` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.802111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea7e2a5f02748b5938b5e4df2c8e853)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:32.804043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:32.849561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea7e2a5f02748b5938b5e4df2c8e853'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:32.856502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea7e2a5f02748b5938b5e4df2c8e853'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:32.857201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea7e2a5f02748b5938b5e4df2c8e853'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:32.865780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea7e2a5f02748b5938b5e4df2c8e853'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:32.873685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:32.879367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea7e2a5f02748b5938b5e4df2c8e853'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:32.886025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1209/2465] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:32 2022] DELETE /identity/v3/users/cea7e2a5f02748b5938b5e4df2c8e853 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:32.890546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:32.891048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:32.891152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:32.909639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:32.910821 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:32.971116 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1257/2466] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:32.981605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:32.983070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:33.042678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3ce-8cf0-4acd-8d54-27e4182d78dc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.048195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.049124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.049597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.050068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.062416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.063884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.073348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1210/2467] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:33.381890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.383515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:33.398347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d6e0-aff9-4a54-9415-c4b130748ed4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.403349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.404054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.404339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.404673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] PATH_INFO: `/v3/projects/fdfff8d5c8314425af07daa9b0d9dfd5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.406448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfff8d5c8314425af07daa9b0d9dfd5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.408351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.464143 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfff8d5c8314425af07daa9b0d9dfd5', 'request_id': 'req-dd11d286-174c-4a04-b45c-cffc27b8f006'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.471267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfff8d5c8314425af07daa9b0d9dfd5', 'request_id': 'req-dd11d286-174c-4a04-b45c-cffc27b8f006'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.478193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfff8d5c8314425af07daa9b0d9dfd5', 'request_id': 'req-dd11d286-174c-4a04-b45c-cffc27b8f006'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.495424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] The token cache is being invalidate because project fdfff8d5c8314425af07daa9b0d9dfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:33.495700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.496533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.499193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1258/2468] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:33 2022] DELETE /identity/v3/projects/fdfff8d5c8314425af07daa9b0d9dfd5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:33.503036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.513079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a331f72-3fe5-4159-95a7-341e85a8f3c5 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:33.580977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:33.581652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:33.581928 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:33.582193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] PATH_INFO: `/v3/users/e894112dbcd94d4ca989b822ccc9b92e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:33.583337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e894112dbcd94d4ca989b822ccc9b92e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:33.585287 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:33.635971 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e894112dbcd94d4ca989b822ccc9b92e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.644411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e894112dbcd94d4ca989b822ccc9b92e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.645292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e894112dbcd94d4ca989b822ccc9b92e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.654078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e894112dbcd94d4ca989b822ccc9b92e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.669207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-745bfda8-beb7-405c-9b3e-803324a35436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e894112dbcd94d4ca989b822ccc9b92e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:33.682611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1211/2469] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:33 2022] DELETE /identity/v3/users/e894112dbcd94d4ca989b822ccc9b92e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:33.985158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:33.987152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:34.002946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11d286-174c-4a04-b45c-cffc27b8f006 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.049976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.064234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.064892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.065166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.065432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] PATH_INFO: `/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.066557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca3d3c92d3f48059ff6582e06e086cc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.068434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.117885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca3d3c92d3f48059ff6582e06e086cc', 'request_id': 'req-f3531538-369d-4d51-a5c0-e770ad30482d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:34.124853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca3d3c92d3f48059ff6582e06e086cc', 'request_id': 'req-f3531538-369d-4d51-a5c0-e770ad30482d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:34.130428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca3d3c92d3f48059ff6582e06e086cc', 'request_id': 'req-f3531538-369d-4d51-a5c0-e770ad30482d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:34.144262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] The token cache is being invalidate because project 5ca3d3c92d3f48059ff6582e06e086cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:34.144547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:34.145237 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3531538-369d-4d51-a5c0-e770ad30482d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:34.146797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1259/2470] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:33 2022] DELETE /identity/v3/projects/5ca3d3c92d3f48059ff6582e06e086cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:34.152116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.152665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.152841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.176386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:34.178691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:34.187706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.243056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1212/2471] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:34.253212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.253560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.253830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.274801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:34.276007 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:34.284349 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1260/2472] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:34.295556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.306610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0d06-3311-41ce-9bd4-0f0df3273fd8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.311223 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.312626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.312930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.313197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.313921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:34.314219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.315815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.328023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1213/2473] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:34.332618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.342315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5211-5e02-4563-92c4-fadc73f118be None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.350038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.350664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.350949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.351215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.351876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.353823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.386750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1261/2474] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:34.392621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.403132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c6e5-4e04-4a93-8ae1-a9a6bf714385 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.464516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.465178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.465450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.465722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.466396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.468348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.491129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1214/2475] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:34.495401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.506722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfb15e-cfd5-45ba-96a2-2dd4a0b9a2b4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.511380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.511996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.512285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.512563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.513363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.514970 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.525316 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1262/2476] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:34.529264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.540257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922e3b2-d380-444f-b27b-430aa67e5a8f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.544978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.545603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.545911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.546787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.547485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.549110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57288f19-953d-40bd-85da-e577bcfce1c3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.559774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1215/2477] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:34.563962 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.574182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05a93-3ee7-4e6a-8f33-024402ea138a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.579063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.579721 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.580000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.580275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] PATH_INFO: `/v3/projects/2b4fe693993b40e094eeb88eb2e3f542/users/376805faabf3443a83c9e28e484b51b6/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.595431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4fe693993b40e094eeb88eb2e3f542, user_id=376805faabf3443a83c9e28e484b51b6, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.598096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.611362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1263/2478] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:34 2022] PUT /identity/v3/projects/2b4fe693993b40e094eeb88eb2e3f542/users/376805faabf3443a83c9e28e484b51b6/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:34.621884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.622173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.622467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.649471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] MFA Rules not processed for user `376805faabf3443a83c9e28e484b51b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:34.650683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:34.715989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1216/2479] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:34.721114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.782510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a309e4-8aa4-48f6-8d86-215e39723cd9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.787198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.787804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.788077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.788341 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.789042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.790951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.810567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.819020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1264/2480] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:34.822864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.833427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22615d06-05fd-4b32-8a90-d06ce798bdb6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.838178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:34.895426 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.896058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.896335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.896609 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.897307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.899250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.921881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1217/2481] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:34 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:34.925837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.937654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b2ba-3413-476c-bfde-daae856c9f3d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.942248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.942858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.943145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.943420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.944113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.945730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:34.957675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1265/2482] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:34.961433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:34.972678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2d60-8495-4874-b60c-2c46deea0fcc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:34.977555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:34.978253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:34.978535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:34.978832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] PATH_INFO: `/v3/projects/85d93ab02ae948668a0434552fbf50c4/users/bc48eab34c6e48f093f57e74d8a82075/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:34.995096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d93ab02ae948668a0434552fbf50c4, user_id=bc48eab34c6e48f093f57e74d8a82075, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:34.997813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.014335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1218/2483] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:34 2022] PUT /identity/v3/projects/85d93ab02ae948668a0434552fbf50c4/users/bc48eab34c6e48f093f57e74d8a82075/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:35.019124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.033523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d305e3-27d1-4db7-b90e-d510352fcec0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.089928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.090550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.090823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.091093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.091787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.094020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71469bf7-3e3e-488b-9ed3-82389e0ba8cc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.104139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1266/2484] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:35.108529 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.118851 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3668b5-40e2-4fcd-baa7-b638bd076d64 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.123469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.124128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.124407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.124717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] PATH_INFO: `/v3/projects/85d93ab02ae948668a0434552fbf50c4/users/bc48eab34c6e48f093f57e74d8a82075/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.126710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d93ab02ae948668a0434552fbf50c4, user_id=bc48eab34c6e48f093f57e74d8a82075, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.129384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.148291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1219/2485] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:35 2022] PUT /identity/v3/projects/85d93ab02ae948668a0434552fbf50c4/users/bc48eab34c6e48f093f57e74d8a82075/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:35.159211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.159496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.159765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.191768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] MFA Rules not processed for user `bc48eab34c6e48f093f57e74d8a82075`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:35.193034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:35.260208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1267/2486] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:35.272252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.273994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:35.340049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4967aa-20d2-4563-b6e8-c714d3562319 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.343580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.344192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.344469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.344783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.353629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.355045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b2af0-745a-4082-801d-c352f899442b service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.364278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1220/2487] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:35.784161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:35.845836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1291e-def8-4af0-92b6-1a103290332e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:35.850456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:35.851025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.851300 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.851569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] PATH_INFO: `/v3/users/376805faabf3443a83c9e28e484b51b6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.852729 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376805faabf3443a83c9e28e484b51b6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:35.854649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:35.865473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:35.901495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376805faabf3443a83c9e28e484b51b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:35.902152 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376805faabf3443a83c9e28e484b51b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:35.913943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376805faabf3443a83c9e28e484b51b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:35.921568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376805faabf3443a83c9e28e484b51b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:35.922175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376805faabf3443a83c9e28e484b51b6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:35.934265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1268/2488] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:35 2022] DELETE /identity/v3/users/376805faabf3443a83c9e28e484b51b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:35.939281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:35.939569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:35.939841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:35.958096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:35.959291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:36.016924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1221/2489] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:36.026626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.028032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:36.100760 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ab30-052e-495a-bc2e-139a409e08f6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.104919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.105734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.106011 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.106281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.121483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.122959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.135308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1269/2490] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:36.422047 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.423583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:36.432019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.436024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c556-59fd-41ce-b45e-7cfcbf7508d6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.442121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.443143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.443434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.443715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] PATH_INFO: `/v3/projects/2b4fe693993b40e094eeb88eb2e3f542` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.444968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4fe693993b40e094eeb88eb2e3f542)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.446830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.503158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4fe693993b40e094eeb88eb2e3f542', 'request_id': 'req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.509525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4fe693993b40e094eeb88eb2e3f542', 'request_id': 'req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.516208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4fe693993b40e094eeb88eb2e3f542', 'request_id': 'req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.529122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] The token cache is being invalidate because project 2b4fe693993b40e094eeb88eb2e3f542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:36.529436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.530070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.532174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1222/2491] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:36 2022] DELETE /identity/v3/projects/2b4fe693993b40e094eeb88eb2e3f542 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:36.536122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.545994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee6cfd-4254-4449-bb2c-a9ccdc47b160 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:36.613610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:36.614273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:36.614571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:36.614829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] PATH_INFO: `/v3/users/bc48eab34c6e48f093f57e74d8a82075` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:36.616040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc48eab34c6e48f093f57e74d8a82075)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:36.618015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:36.655180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:36.670755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc48eab34c6e48f093f57e74d8a82075'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.671417 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc48eab34c6e48f093f57e74d8a82075'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.683870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc48eab34c6e48f093f57e74d8a82075'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.692373 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc48eab34c6e48f093f57e74d8a82075'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.693050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4a2c68ce-a17d-47fc-96ae-f6f688f79c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc48eab34c6e48f093f57e74d8a82075'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:36.708590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1270/2492] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:36 2022] DELETE /identity/v3/users/bc48eab34c6e48f093f57e74d8a82075 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:36.986260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:36.987719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:37.007181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c2fba-e44f-4a8b-8c54-9eeb3b78463a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.063621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.064267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.064544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.064843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] PATH_INFO: `/v3/projects/85d93ab02ae948668a0434552fbf50c4` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.065975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d93ab02ae948668a0434552fbf50c4)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.067884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.122255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d93ab02ae948668a0434552fbf50c4', 'request_id': 'req-ad277e0b-3325-425a-9dad-75573caf3d74'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:37.133568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d93ab02ae948668a0434552fbf50c4', 'request_id': 'req-ad277e0b-3325-425a-9dad-75573caf3d74'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:37.145813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d93ab02ae948668a0434552fbf50c4', 'request_id': 'req-ad277e0b-3325-425a-9dad-75573caf3d74'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:37.158707 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] The token cache is being invalidate because project 85d93ab02ae948668a0434552fbf50c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:37.158988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:37.159696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ad277e0b-3325-425a-9dad-75573caf3d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:37.161574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1223/2493] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:36 2022] DELETE /identity/v3/projects/85d93ab02ae948668a0434552fbf50c4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:37.166376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.166979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.166979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.190989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:37.192211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:37.251832 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1271/2494] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:37.260853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.261140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.261409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.281271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:37.282476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:37.290360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1224/2495] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:37.294776 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.308765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b928b6-fc61-449e-a7a1-d87a360d1f0d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.315062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.315688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.315971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.316242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.316972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:37.317280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.318908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.334045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1272/2496] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:37.335121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.344869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128683a9-d0da-4ea3-9d79-038949bae63f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.349410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.350015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.350290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.350557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.351218 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.353162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.363335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.386019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1225/2497] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:37.387488 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.401057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297d6c-2d7b-4e29-ae5a-cfd0a0bb6ed9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.456898 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.457430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.457711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.457984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.458637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.460548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.481428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1273/2498] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:37.486149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.496412 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e269f-d187-493a-9481-c7e20c38b5b4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.501848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.502469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.502747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.503017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.503705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.505351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.515374 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1226/2499] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:37.519360 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.529307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f1a6-e1da-4fd2-bc22-e9bf870beaa4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.534523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.535153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.535455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.535709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.536395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.538019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fabb-70a7-4d08-9b9f-3732a29a3bfb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.549015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1274/2500] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:37.553061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.563010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a049ee-a10c-439a-aeac-bb9a000d7f2b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.567790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.568448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.568790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.569067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] PATH_INFO: `/v3/projects/c476d855c61b4bd0852c2d8457a530ee/users/c00367ead86648b49f13d3e002c180ee/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.583392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c476d855c61b4bd0852c2d8457a530ee, user_id=c00367ead86648b49f13d3e002c180ee, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.586077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.599846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1227/2501] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:37 2022] PUT /identity/v3/projects/c476d855c61b4bd0852c2d8457a530ee/users/c00367ead86648b49f13d3e002c180ee/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:37.610669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.610955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.611273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.638365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] MFA Rules not processed for user `c00367ead86648b49f13d3e002c180ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:37.639566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:37.643994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:37.705852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1275/2502] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:37.710578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.770715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665e808-1131-4928-8d04-199814cac7df admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.775643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.776256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.776539 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.776846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.777498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.779467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.806422 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1228/2503] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:37.810700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.821849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319e4e7-9f22-4c44-bb12-fd06a2209362 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.878243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.878870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.879147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.879415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.880081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.882012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.902476 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1276/2504] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:37 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:37.906537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.917049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d210f-e9ef-4372-bdf3-3052ec4c7606 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.922302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.922915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.923196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.923473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.924160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.925808 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.937978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1229/2505] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:37.942158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:37.951996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769caf9e-03f3-4346-84a2-49f1a0a2b1bb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:37.956766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:37.957414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:37.957690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:37.957957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] PATH_INFO: `/v3/projects/9e30f87b22a74c1ea415b6c888eb0969/users/59d21cad42984df1bf27773b26c4411e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:37.973837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e30f87b22a74c1ea415b6c888eb0969, user_id=59d21cad42984df1bf27773b26c4411e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:37.976419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:37.990199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1277/2506] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:37 2022] PUT /identity/v3/projects/9e30f87b22a74c1ea415b6c888eb0969/users/59d21cad42984df1bf27773b26c4411e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:37.994245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:38.004826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810384-2ecd-4da1-9924-6372248712c8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.059598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.060209 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.060490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.060801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.061485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.063647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb59758-4cad-410a-9b6a-f912d7818a6f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.073307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1230/2507] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:38.077534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:38.088268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4097456-97bf-4224-92d6-079a0529c6ab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.092982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.093646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.093922 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.094194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] PATH_INFO: `/v3/projects/9e30f87b22a74c1ea415b6c888eb0969/users/59d21cad42984df1bf27773b26c4411e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.096122 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e30f87b22a74c1ea415b6c888eb0969, user_id=59d21cad42984df1bf27773b26c4411e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.098767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.109845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1278/2508] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:38 2022] PUT /identity/v3/projects/9e30f87b22a74c1ea415b6c888eb0969/users/59d21cad42984df1bf27773b26c4411e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:38.120785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.121068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.121342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.149748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] MFA Rules not processed for user `59d21cad42984df1bf27773b26c4411e`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:38.150955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:38.162944 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:38.221511 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1231/2509] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:38.232798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:38.235082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:38.292409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1b4a-c6e9-448b-bc5d-0c59d564dbea admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.296761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.297371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.297651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.297919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.306904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.308318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.313916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:38.318895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1279/2510] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:38.362739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:38.364170 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:38.376445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbbe5-3a1d-447b-95c3-98af72931400 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:38.380171 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:38.380891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:38.381176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:38.381447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:38.438294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:38.439803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baebd33-b7cd-4340-bc76-a9a82dfcaafb service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:38.449115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1232/2511] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:41.860040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:41.921097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24fb8f-38bf-4549-9117-57ceff12568e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:41.926541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:41.927165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:41.927441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:41.927710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] PATH_INFO: `/v3/users/c00367ead86648b49f13d3e002c180ee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:41.928863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00367ead86648b49f13d3e002c180ee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:41.930735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:41.981271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00367ead86648b49f13d3e002c180ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:41.982218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00367ead86648b49f13d3e002c180ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:41.995216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00367ead86648b49f13d3e002c180ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.003799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00367ead86648b49f13d3e002c180ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.004750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00367ead86648b49f13d3e002c180ee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.019309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1280/2512] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:41 2022] DELETE /identity/v3/users/c00367ead86648b49f13d3e002c180ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:42.023651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.024120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.024224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.043385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:42.044597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:42.107299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1233/2513] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:42.117183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.118568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:42.175895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975f35-7961-4d98-8204-46bfab124155 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.179481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.180115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.180389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.180673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.190171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.191624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.201123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1281/2514] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:42.471272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.472740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:42.485779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6575-423c-449d-8b07-4b1fc632405c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.490727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.491305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.491606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.491879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] PATH_INFO: `/v3/projects/c476d855c61b4bd0852c2d8457a530ee` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.493045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c476d855c61b4bd0852c2d8457a530ee)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.494930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.541269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:42.545108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c476d855c61b4bd0852c2d8457a530ee', 'request_id': 'req-fbd71f2f-ab1d-47fe-a69f-8807a8447621'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.552164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c476d855c61b4bd0852c2d8457a530ee', 'request_id': 'req-fbd71f2f-ab1d-47fe-a69f-8807a8447621'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.557782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c476d855c61b4bd0852c2d8457a530ee', 'request_id': 'req-fbd71f2f-ab1d-47fe-a69f-8807a8447621'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.571135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] The token cache is being invalidate because project c476d855c61b4bd0852c2d8457a530ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:42.571415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.572011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.573654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1234/2515] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:42 2022] DELETE /identity/v3/projects/c476d855c61b4bd0852c2d8457a530ee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:42.577735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:42.589597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11d8e-f271-4842-8b5f-c4dab4d2433f service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:42.606911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:42.645333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:42.645954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:42.646227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:42.646493 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] PATH_INFO: `/v3/users/59d21cad42984df1bf27773b26c4411e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:42.647610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d21cad42984df1bf27773b26c4411e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:42.649530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:42.696950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d21cad42984df1bf27773b26c4411e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.697869 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d21cad42984df1bf27773b26c4411e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.714359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d21cad42984df1bf27773b26c4411e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.723227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d21cad42984df1bf27773b26c4411e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.723839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3054af37-a682-401e-a095-cad6fd9abd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d21cad42984df1bf27773b26c4411e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:42.736592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1282/2516] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:42 2022] DELETE /identity/v3/users/59d21cad42984df1bf27773b26c4411e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:43.006924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.008404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:43.022525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71f2f-ab1d-47fe-a69f-8807a8447621 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.088854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.089537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.090408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.090684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] PATH_INFO: `/v3/projects/9e30f87b22a74c1ea415b6c888eb0969` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.092228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e30f87b22a74c1ea415b6c888eb0969)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.094844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.152485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e30f87b22a74c1ea415b6c888eb0969', 'request_id': 'req-acc03802-f090-4997-9304-7e9874f270be'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:43.159723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e30f87b22a74c1ea415b6c888eb0969', 'request_id': 'req-acc03802-f090-4997-9304-7e9874f270be'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:43.174105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e30f87b22a74c1ea415b6c888eb0969', 'request_id': 'req-acc03802-f090-4997-9304-7e9874f270be'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:43.189338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] The token cache is being invalidate because project 9e30f87b22a74c1ea415b6c888eb0969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:43.189626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:43.190265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-acc03802-f090-4997-9304-7e9874f270be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:43.192026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1235/2517] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:43 2022] DELETE /identity/v3/projects/9e30f87b22a74c1ea415b6c888eb0969 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:43.197990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.198468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.198562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.218347 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:43.219718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:43.281050 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1283/2518] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:43.288375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.288664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.288953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.309079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:43.310297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:43.318827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1236/2519] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:19:43.323319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.333284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe68251-02d2-4bed-93f2-5a9263c451d1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.338262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.338956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.339201 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.339471 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.340212 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:43.340505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.342299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.357430 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1284/2520] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:43.362749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.373849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b733-f3bd-4328-af59-e9f77246c97a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.379263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.379884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.380198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.380472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.381210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.383120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.417233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1237/2521] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:43.421649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.433480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e445f8-9512-4df4-b2c5-467320ddb764 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.462131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:43.500117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.500788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.501069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.501342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.502015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.503939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.524512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1285/2522] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:43.529151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.540146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed300-6d9e-4154-9df1-5701b3f0a3aa admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.544911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.545530 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.545804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.546088 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.546894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.549105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.559513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1238/2523] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:43.563622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.573548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9fd30-8e16-4bea-b8b8-f1ca880b6417 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.578185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.578794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.579103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.579371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.580062 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.581678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172b9f2-3b35-4ce6-997c-a954ff07b73c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.592710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1286/2524] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:43.597742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.617130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa535e4-bb80-4adb-b7cf-215731cfe39b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.620973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.621651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.621932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.622206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] PATH_INFO: `/v3/projects/4afa950b3e084929979c6e7c5d49f744/users/b42c617476c5401f9bda543f6e975ffe/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.641553 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afa950b3e084929979c6e7c5d49f744, user_id=b42c617476c5401f9bda543f6e975ffe, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.644256 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:43.652626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:43.659693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1239/2525] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:43 2022] PUT /identity/v3/projects/4afa950b3e084929979c6e7c5d49f744/users/b42c617476c5401f9bda543f6e975ffe/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:43.670021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.670303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.670599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.699244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] MFA Rules not processed for user `b42c617476c5401f9bda543f6e975ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:43.700534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:43.897494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1287/2526] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:43.901992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:43.965836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a7d9b-c21c-4926-96ee-ae165c3d241d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:43.971187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:43.971807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:43.972085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:43.972359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:43.973064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:43.974959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.001682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1240/2527] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:43 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:44.005858 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.017280 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e04951-096b-4ac5-ac3e-f75f453e9cd8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.072725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.073337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.073618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.073893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.074552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.076463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.121693 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1288/2528] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:44.125715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.136364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1edb3e-c8b6-4403-b717-bdb9339eed74 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.148942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.149490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.149766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.150034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.150711 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.152293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.162375 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1241/2529] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:44.166389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.173709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.218180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80950194-9401-410b-96f4-0782e9bc191d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.223433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.224043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.224322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.224662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.225350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.226912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52bb66-acf3-4382-841b-51d05d163b68 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.236526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1289/2530] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:44.240920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.277630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a342-866b-40d2-a649-5912477aea80 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.282293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.282953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.283231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.283505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] PATH_INFO: `/v3/projects/249f3f1bf0eb43abbd6bec8ef3dd003d/users/3f48aae7f83d4e74a345c7208fe61e68/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.297010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249f3f1bf0eb43abbd6bec8ef3dd003d, user_id=3f48aae7f83d4e74a345c7208fe61e68, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.299690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.312332 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1242/2531] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:44 2022] PUT /identity/v3/projects/249f3f1bf0eb43abbd6bec8ef3dd003d/users/3f48aae7f83d4e74a345c7208fe61e68/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:44.324245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.324622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.324977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.354600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] MFA Rules not processed for user `3f48aae7f83d4e74a345c7208fe61e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:44.355803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:44.426299 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1290/2532] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:44.430370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.493305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d550e-6b16-4cda-9d1f-fe345c2a7587 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.498043 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.498618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.498899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.499172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.499828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.502292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.524058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.531444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1243/2533] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:44.535469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.546285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe7f09-21a2-4598-b016-71273e6e7b7f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.602592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.603198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.603475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.603741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.604396 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.606321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.628418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1291/2534] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:44.632448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.642787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20845601-cefb-419d-a0f8-4a4c4460fc3e admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.647392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.648001 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.648282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.648557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.649283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.650874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.661344 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1244/2535] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:44.665322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.675591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584e336-e23b-4634-8fe1-45a0ad280937 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.680216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.680851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.681135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.681408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] PATH_INFO: `/v3/projects/4c6f4550e5424372927ac33a705cc1c2/users/7dd5bd3dcbfd436f8c369aed87737f34/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.696311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6f4550e5424372927ac33a705cc1c2, user_id=7dd5bd3dcbfd436f8c369aed87737f34, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.699074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.712129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1292/2536] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:44 2022] PUT /identity/v3/projects/4c6f4550e5424372927ac33a705cc1c2/users/7dd5bd3dcbfd436f8c369aed87737f34/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:44.716124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.726132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c505-0cad-48f3-8439-aa068bdeb1c2 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.782745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.782745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.783028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.783257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.783947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.785576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5366-76bf-4224-8a1b-435e02cae3c3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.795309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1245/2537] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:44.800165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.810244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c64d1-9493-46bf-8c2a-5f306bf41b58 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:44.815387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:44.816072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.816351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.816622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] PATH_INFO: `/v3/projects/4c6f4550e5424372927ac33a705cc1c2/users/7dd5bd3dcbfd436f8c369aed87737f34/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.818586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6f4550e5424372927ac33a705cc1c2, user_id=7dd5bd3dcbfd436f8c369aed87737f34, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:44.821221 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:44.826677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:44.833427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1293/2538] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:44 2022] PUT /identity/v3/projects/4c6f4550e5424372927ac33a705cc1c2/users/7dd5bd3dcbfd436f8c369aed87737f34/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:44.843905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:44.844195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:44.844472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:44.871622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] MFA Rules not processed for user `7dd5bd3dcbfd436f8c369aed87737f34`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:44.872871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:44.939828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1246/2539] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:44.950461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:44.952218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:45.023344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f53d0-31a4-45ab-80b6-98621ebe6f2e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.026937 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.027604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.027901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.028096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.037451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.038855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.048682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1294/2540] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:45.556095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:45.557702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:45.570089 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c449f20-bcbd-4bc6-b897-3d094554f49d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:45.573587 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:45.574208 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:45.574485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:45.574757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:45.631736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:45.633214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86304ea-cec9-49df-a497-50d7e2c1cd10 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:45.642650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1247/2541] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:50.727977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:50.736968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45873a-7e22-413d-aa53-d41b9f616f8f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:50.740611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:50.741312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:50.741589 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:50.741851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:50.804252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:50.805990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:50.815322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1295/2542] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:52.574052 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.574470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.574606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.589053 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:52.627838 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:52.629122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:52.715565 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1248/2543] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:19:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:52.788705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:52.791336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:52.883574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a1e6-1c92-42c5-81c3-e46832250d32 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:52.888761 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:52.890241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:52.890587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:52.891017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:52.903431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:52.905211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc1903-c303-42f8-9e36-1a7c91da2952 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:52.915238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1296/2544] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:19:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:19:53.159787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.263418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b59d8-03fe-4c15-b6ca-61d10d6ba56a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.269175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.269826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.270102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.270371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] PATH_INFO: `/v3/users/b42c617476c5401f9bda543f6e975ffe` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.271670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42c617476c5401f9bda543f6e975ffe)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.274708 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.345074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42c617476c5401f9bda543f6e975ffe'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:53.353064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42c617476c5401f9bda543f6e975ffe'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:53.354028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42c617476c5401f9bda543f6e975ffe'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:53.364610 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42c617476c5401f9bda543f6e975ffe'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:53.380397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42c617476c5401f9bda543f6e975ffe'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:53.387481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1249/2545] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:53 2022] DELETE /identity/v3/users/b42c617476c5401f9bda543f6e975ffe => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:53.391939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.392362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.392812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.425102 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.429907 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:53.431553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:53.512728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1297/2546] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:53.522420 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:53.524029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:53.552881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:53.601186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b71174-1775-4465-820b-6bb4d5d92c66 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:53.607556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:53.608743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:53.609321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:53.609887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:53.623060 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:53.624905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:53.637095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1250/2547] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:54.352713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.352713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:54.360215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a83fd-df8d-45d5-8601-37f2949eeb6a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.370419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.372480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.373021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.373477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] PATH_INFO: `/v3/projects/4afa950b3e084929979c6e7c5d49f744` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.375606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afa950b3e084929979c6e7c5d49f744)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.380233 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.451605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afa950b3e084929979c6e7c5d49f744', 'request_id': 'req-227a0db4-1549-413b-9310-de6591e59149'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.458984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afa950b3e084929979c6e7c5d49f744', 'request_id': 'req-227a0db4-1549-413b-9310-de6591e59149'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.465386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afa950b3e084929979c6e7c5d49f744', 'request_id': 'req-227a0db4-1549-413b-9310-de6591e59149'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.480903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] The token cache is being invalidate because project 4afa950b3e084929979c6e7c5d49f744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:54.481365 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.481833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.483828 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1298/2548] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:54 2022] DELETE /identity/v3/projects/4afa950b3e084929979c6e7c5d49f744 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:54.488885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:54.500284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44497af5-33e2-449b-b98b-959abbdcf1fe service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:54.571176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:54.571960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:54.572303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:54.572662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] PATH_INFO: `/v3/users/3f48aae7f83d4e74a345c7208fe61e68` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:54.573912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f48aae7f83d4e74a345c7208fe61e68)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:54.576474 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:54.633600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f48aae7f83d4e74a345c7208fe61e68'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.641087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f48aae7f83d4e74a345c7208fe61e68'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.642290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f48aae7f83d4e74a345c7208fe61e68'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.658440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f48aae7f83d4e74a345c7208fe61e68'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.677886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f48aae7f83d4e74a345c7208fe61e68'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:54.685784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1251/2549] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:54 2022] DELETE /identity/v3/users/3f48aae7f83d4e74a345c7208fe61e68 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:55.011103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.012930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:55.057342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a0db4-1549-413b-9310-de6591e59149 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.133877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.134525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.134801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.135257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] PATH_INFO: `/v3/projects/249f3f1bf0eb43abbd6bec8ef3dd003d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.136410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249f3f1bf0eb43abbd6bec8ef3dd003d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.138566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.183949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.200432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249f3f1bf0eb43abbd6bec8ef3dd003d', 'request_id': 'req-238acd84-3afd-4ac9-9c72-28b8bf3474c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.209129 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249f3f1bf0eb43abbd6bec8ef3dd003d', 'request_id': 'req-238acd84-3afd-4ac9-9c72-28b8bf3474c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.215436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249f3f1bf0eb43abbd6bec8ef3dd003d', 'request_id': 'req-238acd84-3afd-4ac9-9c72-28b8bf3474c9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.230649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] The token cache is being invalidate because project 249f3f1bf0eb43abbd6bec8ef3dd003d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:55.230929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.231554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.233097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1299/2550] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:55 2022] DELETE /identity/v3/projects/249f3f1bf0eb43abbd6bec8ef3dd003d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:55.237736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.239231 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:55.256353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2e60d-7a8c-495d-b3a8-8fdc5d771453 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.301233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:55.324250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95544ada-028c-4686-be20-748649aca90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.324963 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544ada-028c-4686-be20-748649aca90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.325242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544ada-028c-4686-be20-748649aca90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.325517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544ada-028c-4686-be20-748649aca90f admin admin] PATH_INFO: `/v3/users/7dd5bd3dcbfd436f8c369aed87737f34` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.326663 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95544ada-028c-4686-be20-748649aca90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd5bd3dcbfd436f8c369aed87737f34)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.328568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95544ada-028c-4686-be20-748649aca90f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.388682 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-95544ada-028c-4686-be20-748649aca90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd5bd3dcbfd436f8c369aed87737f34'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.399416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-95544ada-028c-4686-be20-748649aca90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd5bd3dcbfd436f8c369aed87737f34'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.400151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-95544ada-028c-4686-be20-748649aca90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd5bd3dcbfd436f8c369aed87737f34'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.411097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-95544ada-028c-4686-be20-748649aca90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd5bd3dcbfd436f8c369aed87737f34'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.427260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-95544ada-028c-4686-be20-748649aca90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd5bd3dcbfd436f8c369aed87737f34'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.445764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1252/2551] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:55 2022] DELETE /identity/v3/users/7dd5bd3dcbfd436f8c369aed87737f34 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:55.793923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:55.796091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:55.816131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acd84-3afd-4ac9-9c72-28b8bf3474c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:55.879181 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:55.879882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.880167 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.880443 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] PATH_INFO: `/v3/projects/4c6f4550e5424372927ac33a705cc1c2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:55.881666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6f4550e5424372927ac33a705cc1c2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:55.883559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:55.934738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6f4550e5424372927ac33a705cc1c2', 'request_id': 'req-12a000a8-74c7-4d95-8f13-0e4a334c3c76'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.941656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6f4550e5424372927ac33a705cc1c2', 'request_id': 'req-12a000a8-74c7-4d95-8f13-0e4a334c3c76'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.947583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6f4550e5424372927ac33a705cc1c2', 'request_id': 'req-12a000a8-74c7-4d95-8f13-0e4a334c3c76'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.962670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] The token cache is being invalidate because project 4c6f4550e5424372927ac33a705cc1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:55.962981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.963673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-12a000a8-74c7-4d95-8f13-0e4a334c3c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:55.965539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1300/2552] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:55 2022] DELETE /identity/v3/projects/4c6f4550e5424372927ac33a705cc1c2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:55.973388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:55.973912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:55.974038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.039305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:56.040556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:56.105356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1253/2553] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:19:56.114451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.114736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.115008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.135263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:56.136467 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:56.145147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1301/2554] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:56.149939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.165554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89ca7-149e-417a-b4ec-2516326ad172 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.170501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.171129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.171408 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.171684 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.172389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:19:56.173242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.175309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.187471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1254/2555] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:19:56.192437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.202118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939600f1-b744-4ddc-a98d-5e7211b8f7f0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.207166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.207787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.208063 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.208332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.209042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.210963 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.240228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1302/2556] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:19:56.244589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.255317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bded-a5d6-4c1f-8980-cd07e5f836f8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.285730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.335146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.335799 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.336075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.336341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.337335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.339314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.372843 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1255/2557] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:56.376668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.388404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4e55f-76ef-4173-a602-d3feaab0417c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.396222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.396949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.397225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.397491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.398174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.399755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.419043 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1303/2558] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:56.420940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.448498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319785e-d187-4287-a730-797a2624e820 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.453355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.453950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.454229 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.454500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.455194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.456848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7131e-0ad3-4123-b2c5-20bbca3a0845 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.470360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1256/2559] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:56.474816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.486485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe9de-c747-42c5-881b-ed2fdd001df3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.491651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.492401 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.492685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.493000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] PATH_INFO: `/v3/projects/4504b97404d04ca8ad2431196a8edd72/users/d725bfdbdfd040fcacce3c8dc136e967/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.504047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:56.514939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504b97404d04ca8ad2431196a8edd72, user_id=d725bfdbdfd040fcacce3c8dc136e967, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.518174 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.533840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1304/2560] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:56 2022] PUT /identity/v3/projects/4504b97404d04ca8ad2431196a8edd72/users/d725bfdbdfd040fcacce3c8dc136e967/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:56.547212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.547586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.548487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.582554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] MFA Rules not processed for user `d725bfdbdfd040fcacce3c8dc136e967`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:56.589794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:56.692787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1257/2561] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:56.694687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.788325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d09e-6030-4059-a754-3cf5ef25efee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.793957 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.794835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.795309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.795562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.796279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.798325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.843519 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1305/2562] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:56.848994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:56.862654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf76d6-b106-4170-a5cc-0f9aec71ee3d None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:56.956372 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:56.957339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:56.957794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:56.958238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:56.958924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:56.960898 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:56.987503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1258/2563] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:19:56 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:19:56.992139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.002986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435b6aa-4d23-4453-bb9d-770312f3a6c5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.007965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.008607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.008920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.009194 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.009889 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.011448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.023923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1306/2564] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:19:57.028416 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.039956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ea3c-2cfe-49a7-aa26-5c14e16843a8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.045331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.046186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.046662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.046932 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] PATH_INFO: `/v3/projects/d3bd023a2bf54155b3a356d342d1606f/users/b8765100169947cda841aa1164ea5dff/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.063564 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bd023a2bf54155b3a356d342d1606f, user_id=b8765100169947cda841aa1164ea5dff, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.066541 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.069854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.084364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1259/2565] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:57 2022] PUT /identity/v3/projects/d3bd023a2bf54155b3a356d342d1606f/users/b8765100169947cda841aa1164ea5dff/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:57.085674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.103614 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d589dd-6412-40c6-a1fc-7f2d6b3830ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.186078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.186833 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.186950 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.187217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.187904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.189555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd39b36-fde5-4904-86a2-76b4e7d526e1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.202170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1307/2566] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:19:57.208334 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.226594 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e53a5-df28-4b40-ae9d-525ffc9684b0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.234337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.235598 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.235891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.236164 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] PATH_INFO: `/v3/projects/d3bd023a2bf54155b3a356d342d1606f/users/b8765100169947cda841aa1164ea5dff/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.238162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bd023a2bf54155b3a356d342d1606f, user_id=b8765100169947cda841aa1164ea5dff, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.241037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.263993 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1260/2567] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:19:57 2022] PUT /identity/v3/projects/d3bd023a2bf54155b3a356d342d1606f/users/b8765100169947cda841aa1164ea5dff/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:57.265623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.266098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.266504 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.298758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] MFA Rules not processed for user `b8765100169947cda841aa1164ea5dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:57.300079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:57.360374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:57.405550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1308/2568] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:57.413665 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:57.415552 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:57.487366 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad0b8-b7c7-4599-8cfd-e83f42c1b7f1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:57.490768 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:57.491498 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:57.491775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:57.492149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:57.503690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:57.505289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b695ac-d54d-459c-8aaf-2cd97b7d39da service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:57.515904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1261/2569] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:58.185409 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.260282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0def-9a22-45e3-a9f2-4173d3d08ea9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.265946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.267253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.267534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.267812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] PATH_INFO: `/v3/users/d725bfdbdfd040fcacce3c8dc136e967` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.269472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d725bfdbdfd040fcacce3c8dc136e967)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.272382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.334025 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd725bfdbdfd040fcacce3c8dc136e967'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:58.334928 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd725bfdbdfd040fcacce3c8dc136e967'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:58.350984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd725bfdbdfd040fcacce3c8dc136e967'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:58.361492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd725bfdbdfd040fcacce3c8dc136e967'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:58.362527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd725bfdbdfd040fcacce3c8dc136e967'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:58.378689 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1309/2570] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:58 2022] DELETE /identity/v3/users/d725bfdbdfd040fcacce3c8dc136e967 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:19:58.383050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.383546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.383654 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.410866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:19:58.412121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:58.498628 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1262/2571] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:19:58.509147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.510575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:58.575383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c8dc3-6e17-49d0-af38-fbd85c9e307b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:58.582736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:58.583650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:58.583935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:58.584287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:58.600586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:58.606297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:58.618035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1310/2572] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:19:58.992061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:58.995533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:59.019458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e4f4a-bde2-4b46-b483-fde6c38578bb None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.039478 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.040341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.040793 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.041134 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] PATH_INFO: `/v3/projects/4504b97404d04ca8ad2431196a8edd72` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.043390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4504b97404d04ca8ad2431196a8edd72)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.046160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.197868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4504b97404d04ca8ad2431196a8edd72', 'request_id': 'req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.205636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4504b97404d04ca8ad2431196a8edd72', 'request_id': 'req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.217755 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4504b97404d04ca8ad2431196a8edd72', 'request_id': 'req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.242660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] The token cache is being invalidate because project 4504b97404d04ca8ad2431196a8edd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:19:59.243185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.244340 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.246937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1263/2573] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:58 2022] DELETE /identity/v3/projects/4504b97404d04ca8ad2431196a8edd72 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:59.251006 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.257153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.262600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad8c6-1370-48c1-b33c-e6c43c9c8b5a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.342380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.343133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.343465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.343815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] PATH_INFO: `/v3/users/b8765100169947cda841aa1164ea5dff` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.345692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8765100169947cda841aa1164ea5dff)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.347696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.416533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8765100169947cda841aa1164ea5dff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.417239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8765100169947cda841aa1164ea5dff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.431307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8765100169947cda841aa1164ea5dff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.440628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8765100169947cda841aa1164ea5dff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.440628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a5ba5f01-6bfa-4737-9394-9f225f11517e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8765100169947cda841aa1164ea5dff'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.454885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1311/2574] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:19:59 2022] DELETE /identity/v3/users/b8765100169947cda841aa1164ea5dff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:19:59.821864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:19:59.824181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:19:59.841680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7fcc-2490-4bdc-bfe7-3ff9a58aa722 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:19:59.848770 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:19:59.916865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:19:59.917520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:19:59.917926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:19:59.918204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] PATH_INFO: `/v3/projects/d3bd023a2bf54155b3a356d342d1606f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:19:59.919642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bd023a2bf54155b3a356d342d1606f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:19:59.921425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:19:59.981145 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bd023a2bf54155b3a356d342d1606f', 'request_id': 'req-500b8e9e-1436-4847-a3e1-cd6c5223218b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.990470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bd023a2bf54155b3a356d342d1606f', 'request_id': 'req-500b8e9e-1436-4847-a3e1-cd6c5223218b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:19:59.999020 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bd023a2bf54155b3a356d342d1606f', 'request_id': 'req-500b8e9e-1436-4847-a3e1-cd6c5223218b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:00.016945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] The token cache is being invalidate because project d3bd023a2bf54155b3a356d342d1606f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:20:00.017417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:00.018461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-500b8e9e-1436-4847-a3e1-cd6c5223218b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:00.021311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1264/2575] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:19:59 2022] DELETE /identity/v3/projects/d3bd023a2bf54155b3a356d342d1606f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:00.029283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.029746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.030190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.051801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:00.053059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:00.128770 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1312/2576] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:00.138301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.138721 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.139027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.160772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:00.162019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:00.170518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1265/2577] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:00.174647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.188713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aec74-56ea-4d49-9887-afad7645aa32 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.193362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.194086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.194459 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.194825 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.195604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:00.195976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.197576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.215296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1313/2578] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:00.221667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.245494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5c980-f9c6-4886-8da7-00100888d3cc None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.253317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.254042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.254322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.254596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.255270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.257279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.290432 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1266/2579] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:20:00 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:00.291852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.302208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fc8ce-a748-4b22-8c38-aade40a8e3f4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.311279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.376592 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.377241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.377523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.377779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.381176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.383157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.416552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1314/2580] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:00 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:20:00.420275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.434973 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b57cff-6c64-4ec5-83db-57b82d726a97 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.442811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.443509 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.443806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.444071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.444829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.446466 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.464254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1267/2581] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:00.467946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.486155 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99862-0776-4f20-a7e7-0ee7cd3c0677 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.492385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.493513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.493979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.494496 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.499087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.503264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9062e1-6899-43cc-8997-1e269972d931 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.516593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1315/2582] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:00.521280 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.532226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c192f-ac19-4418-93bb-b3f207320383 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.548592 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.549327 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.549608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.549892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] PATH_INFO: `/v3/projects/48203a55f36049978381e957f617d8ce/users/bc14ed8df92d4be0a2bc3fe81a4c4025/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.569410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48203a55f36049978381e957f617d8ce, user_id=bc14ed8df92d4be0a2bc3fe81a4c4025, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.572084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.587308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1268/2583] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:20:00 2022] PUT /identity/v3/projects/48203a55f36049978381e957f617d8ce/users/bc14ed8df92d4be0a2bc3fe81a4c4025/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:00.597815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2127be-da67-4bad-a709-b534239c263f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.598395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2127be-da67-4bad-a709-b534239c263f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.598912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2127be-da67-4bad-a709-b534239c263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.630309 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8c2127be-da67-4bad-a709-b534239c263f None None] MFA Rules not processed for user `bc14ed8df92d4be0a2bc3fe81a4c4025`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:00.631675 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c2127be-da67-4bad-a709-b534239c263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:00.712692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1316/2584] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:00.722624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:00.724764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:00.769335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:00.793193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46dcb-d8e3-4bba-adca-bf4c718a1056 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:00.797077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:00.798601 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:00.798951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:00.799292 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:00.809986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:00.811568 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6fa2e-5116-49ae-9e68-d3ecffb8912e service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:00.821941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1269/2585] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:03.452285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2127be-da67-4bad-a709-b534239c263f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.526424 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2127be-da67-4bad-a709-b534239c263f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.531061 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.531705 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.531981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.532259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] PATH_INFO: `/v3/users/bc14ed8df92d4be0a2bc3fe81a4c4025` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.534138 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc14ed8df92d4be0a2bc3fe81a4c4025)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.536045 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.560435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:03.596432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc14ed8df92d4be0a2bc3fe81a4c4025'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:03.598012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc14ed8df92d4be0a2bc3fe81a4c4025'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:03.615009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc14ed8df92d4be0a2bc3fe81a4c4025'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:03.626292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc14ed8df92d4be0a2bc3fe81a4c4025'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:03.627218 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc14ed8df92d4be0a2bc3fe81a4c4025'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:03.643252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1317/2586] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:20:03 2022] DELETE /identity/v3/users/bc14ed8df92d4be0a2bc3fe81a4c4025 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:03.649185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.649690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.649774 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.672407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:03.673841 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:03.746326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1270/2587] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:20:03.756864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:03.758688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:03.863234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f114d-77e8-4c86-8d63-ac32eec51464 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:03.867505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:03.868149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:03.868453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:03.868747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:03.880448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:03.882260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:03.894767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1318/2588] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:04.227018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:04.228559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:04.243497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cbe38-9928-421a-8d52-831e6844601f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:04.248844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:04.249515 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:04.250312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:04.250312 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] PATH_INFO: `/v3/projects/48203a55f36049978381e957f617d8ce` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:04.251310 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48203a55f36049978381e957f617d8ce)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:04.253742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:04.310114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48203a55f36049978381e957f617d8ce', 'request_id': 'req-962bd183-9840-4d96-bcd5-ee015adf0f44'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:04.318688 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48203a55f36049978381e957f617d8ce', 'request_id': 'req-962bd183-9840-4d96-bcd5-ee015adf0f44'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:04.327655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48203a55f36049978381e957f617d8ce', 'request_id': 'req-962bd183-9840-4d96-bcd5-ee015adf0f44'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:04.341795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] The token cache is being invalidate because project 48203a55f36049978381e957f617d8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:20:04.342122 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:04.342747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-962bd183-9840-4d96-bcd5-ee015adf0f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:04.344283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1271/2589] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:20:04 2022] DELETE /identity/v3/projects/48203a55f36049978381e957f617d8ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:08.094746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:08.096711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:08.187008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:08.190529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8ffb0-1072-439e-9773-67d0cc5a430f service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:08.250375 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:08.250994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:08.251270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:08.252070 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:08.253842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:08.264836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:08.266384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:08.276704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1319/2590] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:11.711108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b7ec-de40-442e-84db-c72370d77288 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.711584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b7ec-de40-442e-84db-c72370d77288 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.711946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68b7ec-de40-442e-84db-c72370d77288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.732303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0b68b7ec-de40-442e-84db-c72370d77288 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:11.733551 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0b68b7ec-de40-442e-84db-c72370d77288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:11.789360 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1272/2591] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:20:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:11.801216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:11.802798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:11.871383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394588f-f71c-4799-9049-905fdd748931 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:11.876490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:11.877642 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:11.877918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:11.878183 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:11.886451 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:11.887999 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:11.896849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1320/2592] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:20:21.781975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:21.892773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=62 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:30.554160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.554675 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.554769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.575346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:30.576518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:30.584305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1273/2593] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:30.597845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:30.608273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4d882-719b-4b00-bb79-ce18411c40be service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:30.613135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:30.613784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:30.614059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:30.614323 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:30.623287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:30.624878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:30.633540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1321/2594] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:20:32.134694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:32.137085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:32.192400 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8529cf7-7061-48d2-9a5f-920948fc350a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:32.195934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:32.196547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:32.196852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:32.197123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:32.198879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:32.258834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:32.260263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:32.269849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1274/2595] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:38.603658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:38.613171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b481a6-74ac-4114-b216-7866c80981c9 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:38.617001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:38.617555 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:38.617830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:38.618097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:38.620134 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:38.684933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:38.686369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:38.696068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1322/2596] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:41.887198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:41.888730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:41.913765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269276-6f49-41c1-922a-3e9b51688384 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:41.919150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:41.919885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:41.920410 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:41.920937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:41.923807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:41.948578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:41.948578 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:41.956290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1275/2597] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:45.236048 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.239305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:45.252245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b7565-3bbd-4b5a-b8a6-576bf1d470da service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.256954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.257662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.257943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.258211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] PATH_INFO: `/v3/users/4512745d3df04222851af1683753574f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.259368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4512745d3df04222851af1683753574f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.261785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.313220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4512745d3df04222851af1683753574f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.314087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4512745d3df04222851af1683753574f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.329647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4512745d3df04222851af1683753574f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.337927 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4512745d3df04222851af1683753574f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.338672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4512745d3df04222851af1683753574f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.352988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1323/2598] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:20:45 2022] DELETE /identity/v3/users/4512745d3df04222851af1683753574f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:20:45.542042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.555575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d62f1-4b5b-48e9-a094-26c97ef16e15 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.625919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.626992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.628606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.629099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] PATH_INFO: `/v3/projects/51a036f5d3ae444ca8cc9ab201df6f89` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.630821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a036f5d3ae444ca8cc9ab201df6f89)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.633087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.687646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.706751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a036f5d3ae444ca8cc9ab201df6f89', 'request_id': 'req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.715213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a036f5d3ae444ca8cc9ab201df6f89', 'request_id': 'req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.724181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a036f5d3ae444ca8cc9ab201df6f89', 'request_id': 'req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.747767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] The token cache is being invalidate because project 51a036f5d3ae444ca8cc9ab201df6f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:20:45.748057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.748824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.750652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1276/2599] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:20:45 2022] DELETE /identity/v3/projects/51a036f5d3ae444ca8cc9ab201df6f89 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:45.755101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:45.756741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:45.783971 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07c85f-08e3-4c03-9c6e-2674f033ef6f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:45.858984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:45.876728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:45.878502 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:45.878887 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:45.879262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] PATH_INFO: `/v3/users/c8f6719ac3e84449b3c64aa684213c10` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:45.881313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f6719ac3e84449b3c64aa684213c10)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:45.883728 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:45.954270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f6719ac3e84449b3c64aa684213c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.955071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f6719ac3e84449b3c64aa684213c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.974336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f6719ac3e84449b3c64aa684213c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.981688 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f6719ac3e84449b3c64aa684213c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.982336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f6719ac3e84449b3c64aa684213c10'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:45.996190 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1324/2600] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:20:45 2022] DELETE /identity/v3/users/c8f6719ac3e84449b3c64aa684213c10 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:46.174787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:46.177736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:46.195563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1053-c24e-4a3a-a5d8-b9f4eedfe0cb admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:46.287807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:46.288471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:46.288834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:46.289115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] PATH_INFO: `/v3/projects/f13164ba31a44f8bb7890513517a5cfa` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:46.290297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13164ba31a44f8bb7890513517a5cfa)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:46.292227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:46.343905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13164ba31a44f8bb7890513517a5cfa', 'request_id': 'req-838b198d-77a9-4439-b5b1-ad5266c1f6ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:46.351016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13164ba31a44f8bb7890513517a5cfa', 'request_id': 'req-838b198d-77a9-4439-b5b1-ad5266c1f6ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:46.356988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13164ba31a44f8bb7890513517a5cfa', 'request_id': 'req-838b198d-77a9-4439-b5b1-ad5266c1f6ec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:46.370607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] The token cache is being invalidate because project f13164ba31a44f8bb7890513517a5cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:20:46.370895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:46.371513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:46.373243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1277/2601] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:20:46 2022] DELETE /identity/v3/projects/f13164ba31a44f8bb7890513517a5cfa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:51.170015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:51.171437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:51.233000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3994e7-e43b-4b31-90fc-6951b869e29d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:51.288069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:51.289269 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:51.289607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:51.289771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:51.291673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:51.337692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:51.360160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:51.361616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:51.371940 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1325/2602] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:20:54.525995 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:54.527620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:54.541033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b198d-77a9-4439-b5b1-ad5266c1f6ec admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:54.545846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:54.546472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:54.546746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:54.547012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] PATH_INFO: `/v3/users/343be19d43aa42a9a0ac7bb88b12e425` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:54.548146 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=343be19d43aa42a9a0ac7bb88b12e425)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:54.550696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:54.602195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343be19d43aa42a9a0ac7bb88b12e425'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.605142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:54.611627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343be19d43aa42a9a0ac7bb88b12e425'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.612911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343be19d43aa42a9a0ac7bb88b12e425'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.625915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343be19d43aa42a9a0ac7bb88b12e425'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.653491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-94206597-8cf5-45b8-8bd9-e5c307ededfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343be19d43aa42a9a0ac7bb88b12e425'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.661417 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1278/2603] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:20:54 2022] DELETE /identity/v3/users/343be19d43aa42a9a0ac7bb88b12e425 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:54.848057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:54.871296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7d523-7b33-4c5b-ba44-49ba6a9c4230 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:54.931619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:54.932158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:54.932439 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:54.932739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] PATH_INFO: `/v3/projects/c1c619ab10a94b95b8abf82f3775a971` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:54.933905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c619ab10a94b95b8abf82f3775a971)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:54.935794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:54.983506 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c619ab10a94b95b8abf82f3775a971', 'request_id': 'req-b2c3afbe-946b-48f8-a596-7c83b13827c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.990320 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c619ab10a94b95b8abf82f3775a971', 'request_id': 'req-b2c3afbe-946b-48f8-a596-7c83b13827c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:54.995845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c619ab10a94b95b8abf82f3775a971', 'request_id': 'req-b2c3afbe-946b-48f8-a596-7c83b13827c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:55.009857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] The token cache is being invalidate because project c1c619ab10a94b95b8abf82f3775a971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:20:55.010205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:55.010831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b2c3afbe-946b-48f8-a596-7c83b13827c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:20:55.012361 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1326/2604] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:20:54 2022] DELETE /identity/v3/projects/c1c619ab10a94b95b8abf82f3775a971 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:55.017283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.017571 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.017835 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.039018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:55.040379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:55.108352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1279/2605] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:55.116819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.117334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.117606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.137879 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:55.139086 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:55.147700 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1327/2606] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:55.151986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.162341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f897ac-9568-4141-934a-a469b2f2e908 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.166965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.167582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.167862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.168136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.168862 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:20:55.169167 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.170773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.182766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1280/2607] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:20:55.186979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.196106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c581-3204-4100-a1b4-7d10402e22d3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.201065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.201684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.201964 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.202234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.202906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.204872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.234160 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1328/2608] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:55.238857 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.248846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe096f-d760-4053-8f0a-b71b63c82d58 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.307227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.307875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.308155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.308470 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.309172 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.311072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.333477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1281/2609] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:20:55.337769 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.349564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebfd35-b859-4bc6-abe1-8934f7fa6cb5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.354137 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.354738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.355016 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.355283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.355966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.357572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.367980 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1329/2610] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:55.371842 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.381713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e52f-eb50-46ae-8d15-778b19707703 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.386318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.386915 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.387192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.387460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.388394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.390110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75664ff-31c7-4f91-bb3a-5f3f94f32b6a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.400629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1282/2611] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:20:55.404716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.414981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a73c-1cc1-4382-8cfe-263191392bd5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.419433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.420077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.420354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.420652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] PATH_INFO: `/v3/projects/fa29ba635e1140098c3366c660232ffa/users/c9c3bf66cf4446e7824393be27f8e3cd/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.435426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa29ba635e1140098c3366c660232ffa, user_id=c9c3bf66cf4446e7824393be27f8e3cd, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.437996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.451422 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1330/2612] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:20:55 2022] PUT /identity/v3/projects/fa29ba635e1140098c3366c660232ffa/users/c9c3bf66cf4446e7824393be27f8e3cd/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:20:55.463720 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.464008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.464305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.491442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] MFA Rules not processed for user `c9c3bf66cf4446e7824393be27f8e3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:20:55.492701 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:55.513003 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:55.559325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1283/2613] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:20:55.570649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:20:55.572302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:20:55.577014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:55.651193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f63885-2090-44e7-bf3a-3fe78fc902c6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:20:55.654813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:20:55.655420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:20:55.655697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:20:55.655965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:20:55.664092 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:20:55.665551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d90c4-0047-4fc1-9112-0e7acb92464f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:20:55.674101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1331/2614] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:20:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:04.011183 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.076224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cf6f-1b54-4604-a010-7cab2b2703fe None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.081270 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.081917 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.082197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.082467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] PATH_INFO: `/v3/users/c9c3bf66cf4446e7824393be27f8e3cd` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.083629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c3bf66cf4446e7824393be27f8e3cd)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.085575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.134545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c3bf66cf4446e7824393be27f8e3cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.141380 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c3bf66cf4446e7824393be27f8e3cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.142032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c3bf66cf4446e7824393be27f8e3cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.149790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c3bf66cf4446e7824393be27f8e3cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.162036 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c3bf66cf4446e7824393be27f8e3cd'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.170871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1284/2615] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:04 2022] DELETE /identity/v3/users/c9c3bf66cf4446e7824393be27f8e3cd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:04.176283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.177243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.177566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.197503 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:04.198731 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:04.256412 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1332/2616] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:04.265950 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.267347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:04.313941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:04.327631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527bb41-24ef-4663-a21c-29cbe06bd617 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.331556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.332178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.332460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.332777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.342083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.343513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4468e-9d81-49b4-87ea-61fa9950c062 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.353452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1285/2617] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:04.626461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.628480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:04.641602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775c072-8798-42f7-8aa4-44cfe2b1492b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.651002 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.651751 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.652166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.652583 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] PATH_INFO: `/v3/projects/fa29ba635e1140098c3366c660232ffa` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.653960 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa29ba635e1140098c3366c660232ffa)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.656332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.703239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa29ba635e1140098c3366c660232ffa', 'request_id': 'req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.710079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa29ba635e1140098c3366c660232ffa', 'request_id': 'req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.715881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa29ba635e1140098c3366c660232ffa', 'request_id': 'req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.728473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] The token cache is being invalidate because project fa29ba635e1140098c3366c660232ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:04.728811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.729415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ebda6f96-5c7e-4f8b-a38a-30c91cb153d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:04.730897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1333/2618] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:04 2022] DELETE /identity/v3/projects/fa29ba635e1140098c3366c660232ffa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:04.735836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.736129 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.736407 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.756574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:04.757856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:04.815402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1286/2619] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:04.823232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.823514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.823812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.843857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:04.845302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:04.853946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1334/2620] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:04.858203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.868821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf157b95-ad6f-4de2-8e0c-1e464c84c03a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.873633 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.874279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.874560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.874830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.875521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:04.875825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.878068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.889937 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1287/2621] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:04.894716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.900228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:04.903969 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bbafe-6782-410c-bbd9-1e8592e464ec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:04.911023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:04.911668 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:04.912133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:04.912582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:04.913291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:04.915165 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:04.940771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1335/2622] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:04 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:04.944844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:04.954618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652705-4c13-4e53-9bc8-7c4f9f92c01a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.010063 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.010603 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.010882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.011153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.011813 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.013757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.034852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1288/2623] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:04 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:05.038973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.049231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1b675-b6ca-4ab8-9398-be4ed4777e7a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.053803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.054404 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.054684 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.054956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.055640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.057257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.066912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1336/2624] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:05.070749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.081242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904e93f-a011-47a1-93fe-2cec17d7e96f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.085782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.086391 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.086927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.087199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.087886 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.089512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a2f1c-567d-44ef-8bde-70f0caa2a02e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.100959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1289/2625] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:05.105069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.115169 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346be4-935f-42e6-9faf-c67f7de06f98 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.119820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.120497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.120815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.121087 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] PATH_INFO: `/v3/projects/09a9e576430547dfa0684868a37565d3/users/35a8eda71e104ce7bfa7e00399b7d044/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.135877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a9e576430547dfa0684868a37565d3, user_id=35a8eda71e104ce7bfa7e00399b7d044, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.138513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.151273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1337/2626] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:05 2022] PUT /identity/v3/projects/09a9e576430547dfa0684868a37565d3/users/35a8eda71e104ce7bfa7e00399b7d044/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:05.161544 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.161879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.162206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.189168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] MFA Rules not processed for user `35a8eda71e104ce7bfa7e00399b7d044`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:05.190909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:05.235268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:05.261357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1290/2627] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:05.265780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.326338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db86470-c96c-404c-ba81-5c7413967c5f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.330986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.331586 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.331865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.332139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.332829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.334701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.361989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1338/2628] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:05 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:05.366061 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.379967 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787b367-5e83-4e47-b5a8-144a4a3e4338 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.436245 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.436899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.437178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.437448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.438100 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.440002 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.460776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1291/2629] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:05 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:05.464949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.475618 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7c75a-f79a-4eae-a4a2-3107e9b20a63 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.480139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.480779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.481057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.481325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.482003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.483612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.493874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1339/2630] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:05.497938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.507923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777e97-d6ae-4727-ab49-71d4b6776d74 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.512580 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.513213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.513494 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.513769 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] PATH_INFO: `/v3/projects/664e67ecef7e4248946dde195d8c822b/users/1e0c502ac7e343eab4e33025b6e6dfaf/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.529285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] RBAC: Authorizing `identity:create_grant(project_id=664e67ecef7e4248946dde195d8c822b, user_id=1e0c502ac7e343eab4e33025b6e6dfaf, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.531933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.545133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1292/2631] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:05 2022] PUT /identity/v3/projects/664e67ecef7e4248946dde195d8c822b/users/1e0c502ac7e343eab4e33025b6e6dfaf/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:05.549831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.559577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef2aa-106b-4580-9e4a-c493706ccdee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.614622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.615234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.615513 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.615783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.616464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.618083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8ecb-a221-44d5-83c7-3ec6ffccb916 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.628123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1340/2632] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:05.632749 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.643471 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d634-e31c-4ddd-af03-00052b8b98df admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.648150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.648847 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.649130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.649406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] PATH_INFO: `/v3/projects/664e67ecef7e4248946dde195d8c822b/users/1e0c502ac7e343eab4e33025b6e6dfaf/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.651390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664e67ecef7e4248946dde195d8c822b, user_id=1e0c502ac7e343eab4e33025b6e6dfaf, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.654046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.664604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1293/2633] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:05 2022] PUT /identity/v3/projects/664e67ecef7e4248946dde195d8c822b/users/1e0c502ac7e343eab4e33025b6e6dfaf/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:05.676781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.677072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.677370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.704949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] MFA Rules not processed for user `1e0c502ac7e343eab4e33025b6e6dfaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:05.706179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:05.711742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:05.780538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1341/2634] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:05.792606 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.794357 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:05.851743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9a498-e2bb-4a6f-8f87-1ec8a2e85bf3 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.855381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.855989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.856266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.856534 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:05.866316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:05.867744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:05.877177 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1294/2635] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:21:05.953382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:05.963849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f4f47-708c-401a-85b2-004b5f1d8df9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:05.967470 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:05.968068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:05.968343 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:05.968607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:06.023839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:06.025273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3e174-6f05-426c-8716-5b91c0ebeb73 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:06.034149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1342/2636] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:08.750916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:08.790411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:08.814255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b108ea-d4e2-4d19-adbb-008181cd7b06 service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:08.819314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:08.819957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:08.820239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:08.820516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] PATH_INFO: `/v3/users/35a8eda71e104ce7bfa7e00399b7d044` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:08.821693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a8eda71e104ce7bfa7e00399b7d044)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:08.823597 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:08.868295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a8eda71e104ce7bfa7e00399b7d044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:08.875211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a8eda71e104ce7bfa7e00399b7d044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:08.875905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a8eda71e104ce7bfa7e00399b7d044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:08.882710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a8eda71e104ce7bfa7e00399b7d044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:08.894382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a8eda71e104ce7bfa7e00399b7d044'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:08.900273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1295/2637] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:08 2022] DELETE /identity/v3/users/35a8eda71e104ce7bfa7e00399b7d044 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:08.904718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:08.905247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:08.905359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:08.925816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:08.927017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:08.983081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1343/2638] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:08.993187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:08.994577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:09.051576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c7850-33e4-4d99-ac94-2c98641525ca admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.055215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.055827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.056108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.056381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.066067 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.067487 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:09.078038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1296/2639] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:09.343305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:09.344785 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:09.357176 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbb88-70cf-4aeb-ad55-9135ae3c14a1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.361690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.362362 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.362636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.362906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] PATH_INFO: `/v3/projects/09a9e576430547dfa0684868a37565d3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.364064 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a9e576430547dfa0684868a37565d3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.365982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:09.406990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:09.417262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a9e576430547dfa0684868a37565d3', 'request_id': 'req-a77514f1-9a5f-4a69-9d28-cdd4004296b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.423321 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a9e576430547dfa0684868a37565d3', 'request_id': 'req-a77514f1-9a5f-4a69-9d28-cdd4004296b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.428714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a9e576430547dfa0684868a37565d3', 'request_id': 'req-a77514f1-9a5f-4a69-9d28-cdd4004296b5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.440653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] The token cache is being invalidate because project 09a9e576430547dfa0684868a37565d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:09.440954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.441582 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.443078 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1344/2640] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:09 2022] DELETE /identity/v3/projects/09a9e576430547dfa0684868a37565d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:09.447162 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:09.458616 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed764f2-1152-4612-9bf2-31057ab41f29 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.508419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:09.515294 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.516021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.516481 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.516959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] PATH_INFO: `/v3/users/1e0c502ac7e343eab4e33025b6e6dfaf` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.518781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0c502ac7e343eab4e33025b6e6dfaf)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.520778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:09.566076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0c502ac7e343eab4e33025b6e6dfaf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.573133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0c502ac7e343eab4e33025b6e6dfaf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.573784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0c502ac7e343eab4e33025b6e6dfaf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.580784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0c502ac7e343eab4e33025b6e6dfaf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.592811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2d24662-db36-4f27-b00c-d34b2a9489ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0c502ac7e343eab4e33025b6e6dfaf'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:09.599176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1297/2641] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:09 2022] DELETE /identity/v3/users/1e0c502ac7e343eab4e33025b6e6dfaf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:09.867139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:09.868576 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:09.882125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77514f1-9a5f-4a69-9d28-cdd4004296b5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:09.949841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:09.950523 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:09.950637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:09.950884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] PATH_INFO: `/v3/projects/664e67ecef7e4248946dde195d8c822b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:09.952030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664e67ecef7e4248946dde195d8c822b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:09.953926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.000285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664e67ecef7e4248946dde195d8c822b', 'request_id': 'req-558f36c8-b504-4400-9b2a-cccc26838d28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:10.007009 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664e67ecef7e4248946dde195d8c822b', 'request_id': 'req-558f36c8-b504-4400-9b2a-cccc26838d28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:10.012490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664e67ecef7e4248946dde195d8c822b', 'request_id': 'req-558f36c8-b504-4400-9b2a-cccc26838d28'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:10.024995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] The token cache is being invalidate because project 664e67ecef7e4248946dde195d8c822b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:10.025277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:10.025877 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-558f36c8-b504-4400-9b2a-cccc26838d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:10.027914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1345/2642] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:09 2022] DELETE /identity/v3/projects/664e67ecef7e4248946dde195d8c822b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:10.032283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.032780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.032903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.053428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:10.054635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:10.114314 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1298/2643] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:10.122051 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.122336 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.122605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.142671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:10.143873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:10.151667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1346/2644] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:10.155885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.165757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f58d2-02d0-41b5-acf9-eca3568e0469 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.170281 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.170893 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.171201 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.171507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.172202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:10.172507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.174668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.186119 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1299/2645] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:10.190838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.199836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d431f49-049d-48fb-87f8-6fe53418e7eb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.204435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.205527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.205798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.206066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.206730 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.208593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.237659 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1347/2646] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:10.241763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.251517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7681af-a968-4b14-ba1c-00a2e0805da1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.306975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.307604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.307881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.308156 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.308855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.310753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.320615 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:10.334892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1300/2647] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:10.339308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.350862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79ef99-78d9-48a0-b362-1fa075f30888 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.355387 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.355991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.356267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.356539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.357294 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.358867 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.368497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1348/2648] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:10.372316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.382811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f45ef1-ea8b-4c96-b06e-6134ee0405fe admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.387546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.388158 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.388436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.388744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.389435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.391054 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eef0a9-8d5b-4c86-9f62-4bfbceeeffd6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.402302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1301/2649] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:10.406510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.417253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266d0f-4038-4b12-bbe7-01f6cfcecd03 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.421906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.422556 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.422829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.423096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] PATH_INFO: `/v3/projects/4f43e9366f6446ba82b7c2d21b879cf3/users/c3db45baee574596b2b220c8838863a5/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.435646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:10.438915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f43e9366f6446ba82b7c2d21b879cf3, user_id=c3db45baee574596b2b220c8838863a5, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.442192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.455461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1349/2650] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:10 2022] PUT /identity/v3/projects/4f43e9366f6446ba82b7c2d21b879cf3/users/c3db45baee574596b2b220c8838863a5/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:10.467217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.467501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.467775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.495520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] MFA Rules not processed for user `c3db45baee574596b2b220c8838863a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:10.496757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:10.559934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1302/2651] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:10.564386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.625779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267871-1e2e-44bc-98f7-3c836c79b169 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.630685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.631301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.631580 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.631854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.632548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.634492 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.660645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1350/2652] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:10.664715 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.675864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca05f5-b5cb-46a4-a926-8550d5bb34a8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.731301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.731844 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.732127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.732396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.733076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.734962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.755724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1303/2653] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:10.759663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.770153 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48325-617d-448c-a059-a041e02be14d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.774602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.775206 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.775480 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.775745 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.776416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.778037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.789246 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1351/2654] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:10.793133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.803248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa094-7372-4e42-a40a-6c21549279c0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.807811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.808467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.808779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.809055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] PATH_INFO: `/v3/projects/2701a6dff5634773b7ae99c55aee0db8/users/bb52529dc8ae40db86522524f6823d04/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.823542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2701a6dff5634773b7ae99c55aee0db8, user_id=bb52529dc8ae40db86522524f6823d04, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.826247 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.839559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1304/2655] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:10 2022] PUT /identity/v3/projects/2701a6dff5634773b7ae99c55aee0db8/users/bb52529dc8ae40db86522524f6823d04/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:10.843518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.853914 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b67e61-05c0-47fd-be73-45ff3a6c3c60 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.909369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.909967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.910238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.910622 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.911475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.913074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa83f-6be6-4e36-8e88-fd61639c0eb8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.923211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1352/2656] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:10.927778 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:10.938233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1e5bb-b94d-4f81-a027-4bb36c1e8022 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:10.942910 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:10.943589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.943868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.944140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] PATH_INFO: `/v3/projects/2701a6dff5634773b7ae99c55aee0db8/users/bb52529dc8ae40db86522524f6823d04/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.946160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2701a6dff5634773b7ae99c55aee0db8, user_id=bb52529dc8ae40db86522524f6823d04, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:10.948834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:10.959699 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1305/2657] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:10 2022] PUT /identity/v3/projects/2701a6dff5634773b7ae99c55aee0db8/users/bb52529dc8ae40db86522524f6823d04/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:10.969932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:10.970423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:10.970597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:10.997662 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] MFA Rules not processed for user `bb52529dc8ae40db86522524f6823d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:10.998792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:11.046839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:11.067820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1353/2658] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:11.078388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:11.080732 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:11.108920 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:11.141458 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35533f4-f1e1-425b-9420-e2b6ed3a99b8 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:11.145784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:11.146397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:11.146674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:11.146945 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:11.155733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:11.157188 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcdbdb-f9f1-4937-8a1e-149f09e04335 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:11.166331 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1306/2659] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:12.518754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.579433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5be78-1319-40b6-96c5-ba5d6338e79d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.584559 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.585260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.585540 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.585813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] PATH_INFO: `/v3/users/c3db45baee574596b2b220c8838863a5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.587211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3db45baee574596b2b220c8838863a5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.589243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.635296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3db45baee574596b2b220c8838863a5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:12.635949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3db45baee574596b2b220c8838863a5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:12.648124 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3db45baee574596b2b220c8838863a5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:12.655283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3db45baee574596b2b220c8838863a5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:12.655893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3db45baee574596b2b220c8838863a5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:12.667677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1354/2660] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:12 2022] DELETE /identity/v3/users/c3db45baee574596b2b220c8838863a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:12.672150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.672627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.672744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.691729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:12.692960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:12.753542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1307/2661] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:12.763077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:12.764501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:12.822093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4368a-3e51-422d-be09-e4308bf0f7ca admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:12.825741 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:12.826351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:12.826630 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:12.826900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:12.835886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:12.837624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:12.847639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1355/2662] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:13.114545 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:13.116014 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:13.128548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d500-8026-45e3-a42e-d055386e14f1 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:13.133807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:13.134506 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.134735 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.135121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] PATH_INFO: `/v3/projects/4f43e9366f6446ba82b7c2d21b879cf3` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.136157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f43e9366f6446ba82b7c2d21b879cf3)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:13.138093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:13.186182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f43e9366f6446ba82b7c2d21b879cf3', 'request_id': 'req-985bed4d-7b51-4ef8-97b1-4904bf613900'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.193027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f43e9366f6446ba82b7c2d21b879cf3', 'request_id': 'req-985bed4d-7b51-4ef8-97b1-4904bf613900'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.198461 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f43e9366f6446ba82b7c2d21b879cf3', 'request_id': 'req-985bed4d-7b51-4ef8-97b1-4904bf613900'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.210865 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] The token cache is being invalidate because project 4f43e9366f6446ba82b7c2d21b879cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:13.211151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.212030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.213533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1308/2663] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:13 2022] DELETE /identity/v3/projects/4f43e9366f6446ba82b7c2d21b879cf3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:13.217483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:13.227017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1be0b6-1ccc-41ac-99d2-183d71728435 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:13.231483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:13.286893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:13.287558 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.287835 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.288105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] PATH_INFO: `/v3/users/bb52529dc8ae40db86522524f6823d04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.289256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb52529dc8ae40db86522524f6823d04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:13.291145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:13.337646 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb52529dc8ae40db86522524f6823d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.338277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb52529dc8ae40db86522524f6823d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.350759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb52529dc8ae40db86522524f6823d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.358243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb52529dc8ae40db86522524f6823d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.358875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a14bbdf9-43ce-4bb1-b72f-6ba3ced60045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb52529dc8ae40db86522524f6823d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.370838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1356/2664] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:13 2022] DELETE /identity/v3/users/bb52529dc8ae40db86522524f6823d04 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:13.647125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:13.648546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:13.663200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bed4d-7b51-4ef8-97b1-4904bf613900 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:13.711321 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:13.722952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:13.723629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.723918 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.724185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] PATH_INFO: `/v3/projects/2701a6dff5634773b7ae99c55aee0db8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.725339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2701a6dff5634773b7ae99c55aee0db8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:13.727264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:13.771941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2701a6dff5634773b7ae99c55aee0db8', 'request_id': 'req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.777878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2701a6dff5634773b7ae99c55aee0db8', 'request_id': 'req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.783887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2701a6dff5634773b7ae99c55aee0db8', 'request_id': 'req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.795673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] The token cache is being invalidate because project 2701a6dff5634773b7ae99c55aee0db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:13.795953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.796668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dbb386f5-d5d7-46a4-8bc8-9d2283dafaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:13.798288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1309/2665] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:13 2022] DELETE /identity/v3/projects/2701a6dff5634773b7ae99c55aee0db8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:13.803842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.804333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.804445 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.824257 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:13.825500 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:13.883855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1357/2666] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:13.891782 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.892011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.892290 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.911631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:13.912875 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:13.920745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1310/2667] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:13.925477 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:13.935277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79111ebe-ef75-47c8-9f2e-cda16b15e2df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:13.940227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:13.940851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.941125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.941390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.942068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:13.942368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:13.943930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:13.955055 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1358/2668] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:13.959253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:13.969016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6e398-863d-47d7-9a56-c04bf6da235e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:13.974272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:13.974916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:13.975196 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:13.975468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:13.976141 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:13.978064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.006441 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1311/2669] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:13 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:14.010808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.020908 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4fd2-0398-423e-afe0-2094b6940465 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.032033 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:14.077955 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.078569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.078569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.079192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.079784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.082322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.104873 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1359/2670] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:14.108952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.119210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb78a-5614-48b1-be77-0cfe35c52497 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.123744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.124351 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.124629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.124938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.125625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.127723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.137589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1312/2671] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:14.141447 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.152185 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe5772-2376-4ed2-8d46-6698331e0015 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.156878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.157474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.157750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.158021 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.158719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.160285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6194804-2d2b-4eae-83b8-85937f6c17ef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.170624 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1360/2672] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:14.174623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.184946 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba044355-fe12-4a40-b3f9-4c24ddac3414 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.190023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.190683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.190965 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.191243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] PATH_INFO: `/v3/projects/575a6a4c6cac42729b2568a4c94bfdd1/users/cf44bdc9e86842a59f797e1b13610e5e/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.206113 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575a6a4c6cac42729b2568a4c94bfdd1, user_id=cf44bdc9e86842a59f797e1b13610e5e, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.208787 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.221779 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1313/2673] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:14 2022] PUT /identity/v3/projects/575a6a4c6cac42729b2568a4c94bfdd1/users/cf44bdc9e86842a59f797e1b13610e5e/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:14.232968 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.233253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.233522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.261020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] MFA Rules not processed for user `cf44bdc9e86842a59f797e1b13610e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:14.261808 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:14.324494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1361/2674] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:14.329157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.389939 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306edea7-6ba8-4860-b27a-16c07be83750 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.398044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.398650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.398926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.399194 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.400004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.401972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.429765 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1314/2675] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:14.433804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.444610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aa0d8-0c74-4eee-ba60-6c695e859539 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.499958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.500557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.500857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.501123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.501795 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.503680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.524590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1362/2676] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:14.528619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.534750 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:14.541165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96978ec0-0859-4892-9412-8bd20486620a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.546618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.547259 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.547536 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.547805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.548491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.550740 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.563284 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1315/2677] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:14.567946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.577793 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47380d0-2163-4bf8-924b-97f6b1eee8a4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.582427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.583081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.583426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.584563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] PATH_INFO: `/v3/projects/6fee6c67c16342728936d62092440d7b/users/75b9a7b1d86e4d1fa01a9916cf638ce3/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.595242 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:14.599872 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fee6c67c16342728936d62092440d7b, user_id=75b9a7b1d86e4d1fa01a9916cf638ce3, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.602801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.616297 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1363/2678] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:14 2022] PUT /identity/v3/projects/6fee6c67c16342728936d62092440d7b/users/75b9a7b1d86e4d1fa01a9916cf638ce3/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:14.620264 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.631586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1c5f2-3640-45a3-915b-72ff434508b1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.687215 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.687748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.688023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.688291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.689007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.691282 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6845-360e-49d9-aa5e-151ccdf56f21 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.701117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1316/2679] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:14.705283 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.715650 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66087108-5796-4ccc-89a0-59ae97a8e6fb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.720108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.720829 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.721103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.721369 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] PATH_INFO: `/v3/projects/6fee6c67c16342728936d62092440d7b/users/75b9a7b1d86e4d1fa01a9916cf638ce3/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.723245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fee6c67c16342728936d62092440d7b, user_id=75b9a7b1d86e4d1fa01a9916cf638ce3, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.725848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.735701 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1364/2680] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:14 2022] PUT /identity/v3/projects/6fee6c67c16342728936d62092440d7b/users/75b9a7b1d86e4d1fa01a9916cf638ce3/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:14.746195 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.746700 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.746809 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.775454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] MFA Rules not processed for user `75b9a7b1d86e4d1fa01a9916cf638ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:14.776689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:14.844216 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1317/2681] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:14.856096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:14.857939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:14.914204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c51cdd-043c-4349-aadb-7783d55856d0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:14.917920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:14.918516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:14.918789 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:14.919053 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:14.973436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:14.974758 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:14.983438 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1365/2682] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:16.329173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:16.331413 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:16.343243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3c930-6a7e-48f7-8536-d8ef9ce02f07 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:16.347429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:16.348040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:16.348319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:16.348590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:16.357533 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:16.358885 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b03c0-b84e-4397-bf72-84a0740badaa service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:16.368319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1318/2683] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:20.112629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:20.174059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b51a6-9250-4817-af16-ab20c7ccc194 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:20.178489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:20.179118 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.179395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.179663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] PATH_INFO: `/v3/users/cf44bdc9e86842a59f797e1b13610e5e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.180837 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf44bdc9e86842a59f797e1b13610e5e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:20.182772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:20.217901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:20.232113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf44bdc9e86842a59f797e1b13610e5e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.232787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf44bdc9e86842a59f797e1b13610e5e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.245522 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf44bdc9e86842a59f797e1b13610e5e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.252572 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf44bdc9e86842a59f797e1b13610e5e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.253203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf44bdc9e86842a59f797e1b13610e5e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.265207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1366/2684] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:20 2022] DELETE /identity/v3/users/cf44bdc9e86842a59f797e1b13610e5e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:20.269812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.270271 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.270418 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.289744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:20.290935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:20.341903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:20.351083 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1319/2685] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:20.360807 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:20.362245 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:20.418498 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b843a0-8329-415d-95d9-e6066ad388f4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:20.422120 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:20.422736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.423015 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.423286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.432875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:20.434281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:20.443545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1367/2686] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:20.713026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:20.714406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:20.727091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45e634-3dff-46b9-a5b2-dd75259013a3 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:20.731970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:20.732614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.732921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.733192 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] PATH_INFO: `/v3/projects/575a6a4c6cac42729b2568a4c94bfdd1` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.734524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575a6a4c6cac42729b2568a4c94bfdd1)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:20.736620 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:20.783012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575a6a4c6cac42729b2568a4c94bfdd1', 'request_id': 'req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.790382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575a6a4c6cac42729b2568a4c94bfdd1', 'request_id': 'req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.795923 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575a6a4c6cac42729b2568a4c94bfdd1', 'request_id': 'req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.809153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] The token cache is being invalidate because project 575a6a4c6cac42729b2568a4c94bfdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:20.809449 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.810080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.811623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1320/2687] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:20 2022] DELETE /identity/v3/projects/575a6a4c6cac42729b2568a4c94bfdd1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:20.816177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:20.825607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dce6cf-9431-461f-bd4a-2aefde8a0905 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:20.892104 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:20.892706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:20.892992 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:20.893407 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] PATH_INFO: `/v3/users/75b9a7b1d86e4d1fa01a9916cf638ce3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:20.895172 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b9a7b1d86e4d1fa01a9916cf638ce3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:20.897126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:20.943561 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b9a7b1d86e4d1fa01a9916cf638ce3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.944673 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b9a7b1d86e4d1fa01a9916cf638ce3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.949994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:20.958276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b9a7b1d86e4d1fa01a9916cf638ce3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.965655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b9a7b1d86e4d1fa01a9916cf638ce3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.966305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee645ee0-bade-49e4-9dcf-a5b3ec77ce82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b9a7b1d86e4d1fa01a9916cf638ce3'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:20.978530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1368/2688] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:20 2022] DELETE /identity/v3/users/75b9a7b1d86e4d1fa01a9916cf638ce3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:21.255236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.256753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:21.270011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac334d-f7d1-4eed-bf96-0b70ca7417e1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.327244 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.327897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.328185 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.328456 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] PATH_INFO: `/v3/projects/6fee6c67c16342728936d62092440d7b` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.329638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fee6c67c16342728936d62092440d7b)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.331555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.377329 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fee6c67c16342728936d62092440d7b', 'request_id': 'req-48e89697-92f5-4dc1-b422-e25cbc7347c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:21.383912 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fee6c67c16342728936d62092440d7b', 'request_id': 'req-48e89697-92f5-4dc1-b422-e25cbc7347c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:21.389459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fee6c67c16342728936d62092440d7b', 'request_id': 'req-48e89697-92f5-4dc1-b422-e25cbc7347c6'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:21.401958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] The token cache is being invalidate because project 6fee6c67c16342728936d62092440d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:21.402243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:21.402854 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-48e89697-92f5-4dc1-b422-e25cbc7347c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:21.404353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1321/2689] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:21 2022] DELETE /identity/v3/projects/6fee6c67c16342728936d62092440d7b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:21.409322 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.409817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.409929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.429763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:21.430893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:21.488449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1369/2690] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:21.496395 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.496723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.496997 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.516590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:21.517802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:21.525930 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1322/2691] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:21.530431 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.540047 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf6066-c997-46dc-99d5-1dd8d80b396c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.544629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.545248 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.545524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.545791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.546468 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:21.546766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.548338 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.561856 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1370/2692] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:21.566760 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.576500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1c48-f77b-45dd-ac07-6697f01ee4b7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.581251 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.581864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.582151 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.582453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.583130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.585064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.589874 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:21.615903 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1323/2693] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:21.620037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.630140 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd68d4-7a0e-42aa-8730-103ba681dbce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.686853 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.687421 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.687723 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.687995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.688667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.690569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.711238 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1371/2694] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:21.715660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.726411 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa217-d4e4-42b4-8f7f-fa857682d46a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.731112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.731717 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.731992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.732261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.732979 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.734560 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.744972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1324/2695] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:21.748687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.758528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1e5f1-ec88-4d7d-87d1-f5e51c3bbb93 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.763060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.763655 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.763936 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.764207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.764923 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.766518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4234e10-4ea2-47c9-9e1b-8c2741384129 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.777074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1372/2696] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:21.781184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:21.792165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf79-bee5-4f59-9733-4fe1ae293904 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:21.796743 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:21.797398 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.797678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.797951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] PATH_INFO: `/v3/projects/270bcb8896164477a219f8766d73786a/users/463b3de76ee04cc09ee6763e2197d72e/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.813030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=270bcb8896164477a219f8766d73786a, user_id=463b3de76ee04cc09ee6763e2197d72e, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:21.815712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:21.828328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1325/2697] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:21 2022] PUT /identity/v3/projects/270bcb8896164477a219f8766d73786a/users/463b3de76ee04cc09ee6763e2197d72e/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:21.839660 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:21.839947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:21.840220 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:21.867746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] MFA Rules not processed for user `463b3de76ee04cc09ee6763e2197d72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:21.869060 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:21.896370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:21.936151 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1373/2698] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:21.940683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.003415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bf529-4082-41b8-8c28-5ba08db9c66b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.008018 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.008624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.008935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.009211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.009904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.011853 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.042335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1326/2699] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:21 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:22.043516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.054080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca139b-1174-4a85-8774-d76faebef5ec None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.110128 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.110755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.111035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.111307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.111961 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.113978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.134774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1374/2700] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:22 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:22.139012 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.149669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2db58-79c3-447e-bf8e-7c51771073d9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.154148 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.154751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.155024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.155291 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.155989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.157591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.174081 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1327/2701] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:22.178226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.187990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3601-559d-4a5c-93de-9ba5c617f5c1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.192575 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.193198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.193474 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.193747 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] PATH_INFO: `/v3/projects/57a22a6be2664f108ae773d6d25c6384/users/9e9849d2fe194688b461ac1dcba06fa8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.208602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a22a6be2664f108ae773d6d25c6384, user_id=9e9849d2fe194688b461ac1dcba06fa8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.211226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.224801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1375/2702] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:22 2022] PUT /identity/v3/projects/57a22a6be2664f108ae773d6d25c6384/users/9e9849d2fe194688b461ac1dcba06fa8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:22.228878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.238980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6b31-e35c-4b3c-980b-b758832abc42 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.294207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.294856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.295084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.295354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.296033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.297647 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa8d5b-021d-4955-aad4-0893505acee6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.307112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1328/2703] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:22.311298 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.322170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade790f9-f06f-4a2a-b47f-c361193a29cb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.326834 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.327484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.327764 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.328035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] PATH_INFO: `/v3/projects/57a22a6be2664f108ae773d6d25c6384/users/9e9849d2fe194688b461ac1dcba06fa8/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.329995 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a22a6be2664f108ae773d6d25c6384, user_id=9e9849d2fe194688b461ac1dcba06fa8, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.333284 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.343857 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1376/2704] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:22 2022] PUT /identity/v3/projects/57a22a6be2664f108ae773d6d25c6384/users/9e9849d2fe194688b461ac1dcba06fa8/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:22.353921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.354206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.354477 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.382238 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] MFA Rules not processed for user `9e9849d2fe194688b461ac1dcba06fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:22.383427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:22.391689 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:22.452221 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1329/2705] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:22.464100 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.465909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:22.522077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8504876-fb37-4250-b8b9-b980ff947e26 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.525674 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.526275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.526547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.526813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.535735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.537170 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bb544-ffc4-4259-80b1-3b54a53b60ff service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.546501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1377/2706] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:22.613248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.673428 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526f57-ea94-46d9-a567-bc918d518d37 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.678402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.679033 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.679307 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.679575 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] PATH_INFO: `/v3/users/463b3de76ee04cc09ee6763e2197d72e` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.680959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463b3de76ee04cc09ee6763e2197d72e)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.682733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.733211 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463b3de76ee04cc09ee6763e2197d72e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:22.740111 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463b3de76ee04cc09ee6763e2197d72e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:22.740785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463b3de76ee04cc09ee6763e2197d72e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:22.748120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463b3de76ee04cc09ee6763e2197d72e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:22.759823 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463b3de76ee04cc09ee6763e2197d72e'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:22.765591 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1330/2707] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:22 2022] DELETE /identity/v3/users/463b3de76ee04cc09ee6763e2197d72e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:22.770512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.770794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.771065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.791131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:22.792340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:22.808374 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:22.852209 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1378/2708] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:22.861934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:22.863356 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:22.890752 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:22.922186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b636f-f674-4d1b-8841-1e98b5f7c1b4 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:22.925807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:22.926423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:22.926704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:22.926974 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:22.937392 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:22.938881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:22.948379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1331/2709] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:23.223771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:23.226527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:23.238458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6f2f2-7cab-4412-9491-af07daf9e216 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:23.243000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:23.243697 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.243975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.244244 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] PATH_INFO: `/v3/projects/270bcb8896164477a219f8766d73786a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.245511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] RBAC: Authorizing `identity:delete_project(project_id=270bcb8896164477a219f8766d73786a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:23.247288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:23.294939 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270bcb8896164477a219f8766d73786a', 'request_id': 'req-4d26127a-44c1-4ecd-9361-aab34d65216e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.301757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270bcb8896164477a219f8766d73786a', 'request_id': 'req-4d26127a-44c1-4ecd-9361-aab34d65216e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.307398 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270bcb8896164477a219f8766d73786a', 'request_id': 'req-4d26127a-44c1-4ecd-9361-aab34d65216e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.319924 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] The token cache is being invalidate because project 270bcb8896164477a219f8766d73786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:23.320203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.320855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.322481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1379/2710] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:23 2022] DELETE /identity/v3/projects/270bcb8896164477a219f8766d73786a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:23.326629 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:23.337213 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bcc9b-d792-4c1d-a330-b8ca2075478a service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:23.392362 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:23.393032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.393877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.394155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] PATH_INFO: `/v3/users/9e9849d2fe194688b461ac1dcba06fa8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.395309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9849d2fe194688b461ac1dcba06fa8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:23.397265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:23.443227 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9849d2fe194688b461ac1dcba06fa8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.450121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9849d2fe194688b461ac1dcba06fa8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.450764 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9849d2fe194688b461ac1dcba06fa8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.457775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9849d2fe194688b461ac1dcba06fa8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.470187 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-6fe8fd8b-bd3f-4a79-b863-bd16dd80f97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9849d2fe194688b461ac1dcba06fa8'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.475872 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1332/2711] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:23 2022] DELETE /identity/v3/users/9e9849d2fe194688b461ac1dcba06fa8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:23.745585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:23.747088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:23.762319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26127a-44c1-4ecd-9361-aab34d65216e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:23.820068 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:23.820748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.821032 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.821304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] PATH_INFO: `/v3/projects/57a22a6be2664f108ae773d6d25c6384` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.822463 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a22a6be2664f108ae773d6d25c6384)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:23.824393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:23.870182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:23.871408 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a22a6be2664f108ae773d6d25c6384', 'request_id': 'req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.879271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a22a6be2664f108ae773d6d25c6384', 'request_id': 'req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.885017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a22a6be2664f108ae773d6d25c6384', 'request_id': 'req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.899158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] The token cache is being invalidate because project 57a22a6be2664f108ae773d6d25c6384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:23.899444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.900066 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7d59fd91-2f28-4c5d-8988-ba1a06dc3131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:23.901602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1380/2712] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:23 2022] DELETE /identity/v3/projects/57a22a6be2664f108ae773d6d25c6384 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:23.906504 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.906794 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.907072 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:23.927641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:23.928871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:23.968773 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:23.987958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1333/2713] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:23.996792 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:23.997071 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:23.997334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.016381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:24.017600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:24.025328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1381/2714] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:24.029513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.039730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf80f0f-0311-41d3-8ca8-cde31343cfc6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.044355 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.045011 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.045296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.045572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.046299 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:24.046604 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.048203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.060202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1334/2715] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:24.064199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.073325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718cf7-ab14-42b3-90d3-522944307393 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.077852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.078437 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.078706 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.079088 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.079738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.081649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.115121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1382/2716] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:24 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:24.120186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.130005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1081e-5b9e-4f3e-b76c-aad0f5b649c1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.186446 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.187064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.187341 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.187614 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.188275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.190266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.212464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1335/2717] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:24 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:24.216778 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.227637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b60d0f-551b-4f96-915c-dd4186248dc0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.232222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.232840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.233114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.233376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.234054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.235612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.245337 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1383/2718] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:21:24.249322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.259618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a88ee-96ce-4ce2-ae3b-c68e006d300a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.264322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.264959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.265242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.265514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.266202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.267798 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cbdc0-2452-46ab-aa70-2079577eaca1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.278887 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1336/2719] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:24.282783 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.293327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75909303-df9e-4016-9316-8919315f0675 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.297884 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.298527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.298804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.299073 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] PATH_INFO: `/v3/projects/b459d3b52de64642a00e14ff896f5f54/users/9c278808bf2944afa5a66bc3861a6a29/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.313716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b459d3b52de64642a00e14ff896f5f54, user_id=9c278808bf2944afa5a66bc3861a6a29, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.316333 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.329383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1384/2720] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:24 2022] PUT /identity/v3/projects/b459d3b52de64642a00e14ff896f5f54/users/9c278808bf2944afa5a66bc3861a6a29/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:24.396948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.396948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.397638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.427550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] MFA Rules not processed for user `9c278808bf2944afa5a66bc3861a6a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:24.428815 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:24.492080 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1337/2721] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:24.502797 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:24.504525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:24.560363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578bb8-f574-40a7-9dde-950db68f5cc3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:24.563982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:24.564591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:24.564910 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:24.565687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:24.573920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:24.575326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ff9f-51f1-476a-ab61-c6bebc83f56c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:24.584606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1385/2722] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:27.593908 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:27.638015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:27.657050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf21518-ac4c-40c4-a3b1-328560e95481 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:27.661475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:27.662115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:27.662394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:27.662667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] PATH_INFO: `/v3/users/9c278808bf2944afa5a66bc3861a6a29` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:27.663830 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c278808bf2944afa5a66bc3861a6a29)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:27.665792 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:27.714716 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c278808bf2944afa5a66bc3861a6a29'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:27.721710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c278808bf2944afa5a66bc3861a6a29'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:27.722385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c278808bf2944afa5a66bc3861a6a29'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:27.729317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c278808bf2944afa5a66bc3861a6a29'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:27.741040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c278808bf2944afa5a66bc3861a6a29'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:27.746785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1338/2723] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:27 2022] DELETE /identity/v3/users/9c278808bf2944afa5a66bc3861a6a29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:27.751291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:27.751782 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:27.751891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:27.771313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:27.772516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:27.831852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1386/2724] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:27.841638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:27.843071 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:27.900032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30bfb-5598-4e49-a648-8564980dc6d1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:27.903687 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:27.904301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:27.904584 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:27.904894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:27.914448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:27.915970 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78ae79-f9c3-4c4d-a850-ff5978c7f9f2 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:27.926676 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1339/2725] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:28.192839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.194313 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.207359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba376-7bb8-418e-a5f0-18bcece282eb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.212342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.213193 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.213348 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.213656 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] PATH_INFO: `/v3/projects/b459d3b52de64642a00e14ff896f5f54` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.214818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b459d3b52de64642a00e14ff896f5f54)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.216722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.229125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:28.265335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459d3b52de64642a00e14ff896f5f54', 'request_id': 'req-c4d79961-3c5f-4698-9192-24a20550d17b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:28.271824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459d3b52de64642a00e14ff896f5f54', 'request_id': 'req-c4d79961-3c5f-4698-9192-24a20550d17b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:28.277449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459d3b52de64642a00e14ff896f5f54', 'request_id': 'req-c4d79961-3c5f-4698-9192-24a20550d17b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:28.290037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] The token cache is being invalidate because project b459d3b52de64642a00e14ff896f5f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:28.290317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:28.290919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c4d79961-3c5f-4698-9192-24a20550d17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:28.292429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1387/2726] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:28 2022] DELETE /identity/v3/projects/b459d3b52de64642a00e14ff896f5f54 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:28.297199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.297489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.297789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.317257 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:28.318445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.377833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1340/2727] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:21:28.385979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.386262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.386530 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.406878 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:28.408017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.416759 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1388/2728] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:28.421110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.427371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:28.431884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb84be-c948-46e1-a95b-5651db3d9067 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.437649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.438261 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.438543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.438811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.439507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:28.440121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.442268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.454837 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1341/2729] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:28.463932 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.473525 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d776d-eca9-450d-87dc-5974a330e2c6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.478657 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.479351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.479691 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.480022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.480781 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.482712 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.509737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1389/2730] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:28.514112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.524660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263d71-b7ce-43fb-a323-5766c08c8c56 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.579806 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.580421 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.580734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.581008 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.582241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.584133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.605561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1342/2731] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:28.609634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.619690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebba8b-e628-4d10-9b3c-7907adda2e69 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.624268 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.624885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.625162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.625427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.626101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.627658 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.638012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1390/2732] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:28.642027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.652450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a223da-50e6-4656-b952-0df6e79d7c27 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.657028 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.657632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.657911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.658181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.658868 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.660501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a72ca-f963-46d1-ada7-b5299f3486db admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.670814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1343/2733] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:28.674949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.685208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13726c-e583-44b9-8f1d-651c2904770a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.689719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.690357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.690629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.690892 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] PATH_INFO: `/v3/projects/9963787aee6e46638ba8766284c9d06f/users/67cd5931737b4408935e9544ecc27fcb/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.705652 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9963787aee6e46638ba8766284c9d06f, user_id=67cd5931737b4408935e9544ecc27fcb, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.708241 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.722109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1391/2734] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:28 2022] PUT /identity/v3/projects/9963787aee6e46638ba8766284c9d06f/users/67cd5931737b4408935e9544ecc27fcb/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:28.733532 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ecec-7985-4d01-a896-c5125e174503 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.733829 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ecec-7985-4d01-a896-c5125e174503 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.734095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ecec-7985-4d01-a896-c5125e174503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.762977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-7625ecec-7985-4d01-a896-c5125e174503 None None] MFA Rules not processed for user `67cd5931737b4408935e9544ecc27fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:28.764342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-7625ecec-7985-4d01-a896-c5125e174503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.835104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1344/2735] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:28.846023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:28.847801 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:28.906819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd5bc9-e4be-4779-99a5-cd1c6e3726a6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:28.911162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:28.911883 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:28.912230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:28.912571 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:28.922099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:28.923600 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:28.932920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1392/2736] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:30.300064 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:30.300608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:30.300608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:30.320852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] MFA Rules not processed for user `67cd5931737b4408935e9544ecc27fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:30.322084 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:30.329055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1345/2737] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:34.863817 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:34.865265 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:34.913913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:34.930416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05928-dbc8-4388-8a69-f63b8a22f12f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:34.933997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:34.934606 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:34.934882 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:34.935149 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:34.936902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:34.998490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:34.999909 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:35.010158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1393/2738] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:39.031858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.037200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:39.052866 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a06dd-8456-47dd-91e1-c2fb4339de7b None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.057563 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.058212 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.058497 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.058771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] PATH_INFO: `/v3/users/0db6c2215b304cb3af3aebc565d55278` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.059919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db6c2215b304cb3af3aebc565d55278)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.061877 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.113500 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db6c2215b304cb3af3aebc565d55278'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.115562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:39.122985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db6c2215b304cb3af3aebc565d55278'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.124121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db6c2215b304cb3af3aebc565d55278'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.132402 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db6c2215b304cb3af3aebc565d55278'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.151723 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-dc6a1c8e-769b-40cd-b891-c60b57213950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db6c2215b304cb3af3aebc565d55278'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.158077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1346/2739] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:39 2022] DELETE /identity/v3/users/0db6c2215b304cb3af3aebc565d55278 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:39.342687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.353307 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce865f-f28a-498e-84f6-dfa2415ead1c service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.412340 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.413012 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.413289 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.414173 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] PATH_INFO: `/v3/projects/c4b0b4e5044a419a99876661ce6f9e96` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.415434 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b0b4e5044a419a99876661ce6f9e96)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.417440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.465099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b0b4e5044a419a99876661ce6f9e96', 'request_id': 'req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.471472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b0b4e5044a419a99876661ce6f9e96', 'request_id': 'req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.477890 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b0b4e5044a419a99876661ce6f9e96', 'request_id': 'req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.491667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] The token cache is being invalidate because project c4b0b4e5044a419a99876661ce6f9e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:39.491953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.492562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e4cf85-8a1d-47ab-8ea6-c7c8d9d2611b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:39.494279 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1394/2740] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:39 2022] DELETE /identity/v3/projects/c4b0b4e5044a419a99876661ce6f9e96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:39.499198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.499505 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.499796 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.651496 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:39.652766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:39.713871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1347/2741] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:39.721653 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.721938 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.722236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.742605 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:39.743803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:39.751491 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1395/2742] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:39.755666 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.765255 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303853d-0641-4608-9f27-b6017f91b41a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.769742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.771385 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.771658 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.771925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.772607 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:21:39.772933 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.774499 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.786771 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1348/2743] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:21:39.791372 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.800915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23769f-87fb-4229-98de-553cc35dfa7c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.806098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.806708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.807008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.807225 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.807871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.809767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.819671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:39.838296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1396/2744] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:21:39 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:21:39.842436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.852899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efce143-d284-4e46-b5a4-9f25e662ec0c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.908241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.908913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.909193 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.909468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.910133 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.912625 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.935574 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1349/2745] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:21:39 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:21:39.939772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.950252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2f01-18ec-4df6-ae90-ab097344fb72 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.954803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.955406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.955685 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.955954 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.956654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.958839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:39.968988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1397/2746] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:39.973030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:39.983438 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b06a-a593-448c-976c-2125841d4ebf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:39.987985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:39.988613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:39.988924 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:39.989197 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:39.989879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:39.991459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34e19-f3a5-4dd4-8a1e-a444ca598d37 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:40.001105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1350/2747] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:21:40.004987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:40.017644 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c941a9-8dbf-482f-91d4-803bc665ebcd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:40.021949 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:40.022612 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:40.022893 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:40.023168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] PATH_INFO: `/v3/projects/498c7ca752674265a207ac29d9759b06/users/eab1f0126d634ebd886403914d17ea42/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:40.038634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498c7ca752674265a207ac29d9759b06, user_id=eab1f0126d634ebd886403914d17ea42, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:40.041285 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:40.053966 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1398/2748] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:21:40 2022] PUT /identity/v3/projects/498c7ca752674265a207ac29d9759b06/users/eab1f0126d634ebd886403914d17ea42/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:21:40.059168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4223d-d1f1-457c-b15b-6246fee57134 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:40.059660 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4223d-d1f1-457c-b15b-6246fee57134 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:40.059762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4223d-d1f1-457c-b15b-6246fee57134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:40.078024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-91c4223d-d1f1-457c-b15b-6246fee57134 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:40.079210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-91c4223d-d1f1-457c-b15b-6246fee57134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:40.106026 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:40.141935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1351/2749] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:40.152327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:40.154235 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:40.210458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbd567-d54e-4563-bf74-ebfdd15e47e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:40.214654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:40.215276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:40.215554 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:40.215820 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:40.226023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:40.227564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:40.237798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1399/2750] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:44.291624 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de927-f072-4550-9862-fe1841dfce90 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:44.292161 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de927-f072-4550-9862-fe1841dfce90 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:44.292276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190de927-f072-4550-9862-fe1841dfce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:44.338902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-190de927-f072-4550-9862-fe1841dfce90 None None] MFA Rules not processed for user `eab1f0126d634ebd886403914d17ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:44.340105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-190de927-f072-4550-9862-fe1841dfce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:44.447589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1352/2751] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:44.461754 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:44.467704 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:44.605743 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e63d1-c22b-4fed-8932-9c1e4cfdccd5 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:44.612711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:44.613718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:44.614359 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:44.614805 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:44.630435 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:44.632142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f5ecd-4ceb-428f-b765-2a5edbf906ac service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:44.643839 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1400/2752] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:46.049044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:46.049503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:46.049825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:46.073207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] MFA Rules not processed for user `eab1f0126d634ebd886403914d17ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:46.085881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:46.094104 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1353/2753] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:48.650029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43e15-b808-4a54-bd83-cebf308e5e63 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:48.650518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43e15-b808-4a54-bd83-cebf308e5e63 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:48.650640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f43e15-b808-4a54-bd83-cebf308e5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:48.678947 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-21f43e15-b808-4a54-bd83-cebf308e5e63 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:48.680302 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-21f43e15-b808-4a54-bd83-cebf308e5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:48.698645 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:48.747713 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1401/2754] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:21:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:48.810626 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:48.812742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:48.903984 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19122f-fe46-431e-8bfb-6e2afc148bb8 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:48.909352 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:48.910182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:48.910702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:48.910985 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:48.920989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:48.922761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:48.931976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1354/2755] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:21:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:21:49.519831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195244a-f477-4974-b810-f84f76b75469 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:49.520211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195244a-f477-4974-b810-f84f76b75469 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:49.520489 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195244a-f477-4974-b810-f84f76b75469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:49.541990 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8195244a-f477-4974-b810-f84f76b75469 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:49.543232 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8195244a-f477-4974-b810-f84f76b75469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:49.552844 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1402/2756] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:49.573057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:49.585913 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480cccc-cbd3-4272-9fa6-6cc305fc3aeb service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:49.593130 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:49.593753 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:49.594155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:49.594427 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:49.605520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:49.607704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:49.617632 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1355/2757] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:21:49.864490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda56b-5b3f-48ac-8835-d371da96c97f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:49.865534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda56b-5b3f-48ac-8835-d371da96c97f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:49.865815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eda56b-5b3f-48ac-8835-d371da96c97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:49.889423 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-95eda56b-5b3f-48ac-8835-d371da96c97f None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:49.890809 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-95eda56b-5b3f-48ac-8835-d371da96c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:49.898501 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1403/2758] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:49.912442 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:49.923833 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb67dc7-4285-41f2-905d-e46ebe0a53cf service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:49.929017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:49.929631 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:49.929911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:49.930214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:49.938730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:49.940288 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:49.948762 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1356/2759] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:21:50.369855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:50.370145 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:50.370418 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:50.398562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:50.400750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:50.409093 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1404/2760] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:21:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:50.425662 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:50.437339 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9e8-c80e-41df-9fec-135523756dc4 service swift] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:50.442834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:50.443485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:50.443878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:50.444153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:50.455975 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:50.458302 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18569-9baa-485a-9d60-9283196dbbf9 service swift] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:50.488342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1357/2761] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:21:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 06:21:52.743211 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:52.744602 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:52.758737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f57797-e960-4b68-b7b2-34eee8239b26 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:52.764568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:52.765253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:52.765538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:52.765849 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] PATH_INFO: `/v3/users/67cd5931737b4408935e9544ecc27fcb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:52.767094 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cd5931737b4408935e9544ecc27fcb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:52.769142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:52.822264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cd5931737b4408935e9544ecc27fcb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:52.822944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cd5931737b4408935e9544ecc27fcb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:52.835864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cd5931737b4408935e9544ecc27fcb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:52.844230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cd5931737b4408935e9544ecc27fcb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:52.844973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cd5931737b4408935e9544ecc27fcb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:52.858334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1405/2762] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:21:52 2022] DELETE /identity/v3/users/67cd5931737b4408935e9544ecc27fcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:52.863044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:52.863703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:52.863703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:52.871776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:52.883076 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:21:52.884283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:52.955159 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1358/2763] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:21:52.965527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:52.966919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:53.023942 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6b2e-5ef6-467f-bff6-0680788c54cf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:53.027545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:53.028161 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:53.028436 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:53.028736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:53.037635 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:53.039052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:53.048608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1406/2764] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:53.225608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:53.227453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:53.240191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197e3d3-874c-4953-9a04-dd6261a8458c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:53.245198 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:53.245852 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:53.246155 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:53.246425 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] PATH_INFO: `/v3/projects/9963787aee6e46638ba8766284c9d06f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:53.247583 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9963787aee6e46638ba8766284c9d06f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:53.249691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:53.306382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9963787aee6e46638ba8766284c9d06f', 'request_id': 'req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:53.313070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9963787aee6e46638ba8766284c9d06f', 'request_id': 'req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:53.319304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9963787aee6e46638ba8766284c9d06f', 'request_id': 'req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:53.333996 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] The token cache is being invalidate because project 9963787aee6e46638ba8766284c9d06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:21:53.334278 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:53.334892 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:21:53.336386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1359/2765] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:21:53 2022] DELETE /identity/v3/projects/9963787aee6e46638ba8766284c9d06f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:21:57.188897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:57.198444 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb967131-8e4d-43fb-b682-c11f9bcf8e60 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:57.219079 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:57.257986 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:57.258608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:57.258881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:57.259146 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:57.260904 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:57.341756 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:57.343113 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:57.356534 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1407/2766] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:58.576316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:21:58.577819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:58.590348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc35a7-c2cf-4bb0-8862-fda40c99acf5 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:21:58.593826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:21:58.594435 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:21:58.594714 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:21:58.594986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:21:58.596667 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:21:58.610205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:21:58.611652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437acd8-c77c-4136-8194-32b4664c5b68 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:21:58.623073 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1360/2767] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:21:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:22:07.349432 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=44 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:08.618242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:58.618703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:22:58.627766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed0f5-89cf-4ef9-beac-044cb440903e service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:22:58.631395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:22:58.632000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:22:58.632274 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:22:58.632542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:22:58.634356 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:22:58.644330 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:22:58.645746 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:22:58.653677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1408/2768] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:22:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:23:08.650037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:21.116492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:21.117016 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:21.117120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:21.135646 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] MFA Rules not processed for user `eab1f0126d634ebd886403914d17ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:23:21.136873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:21.190730 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1361/2769] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:23:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:23:21.505866 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:21.515187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e55df-cde4-49e8-bca6-cea16da45e4c service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:21.518737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:21.519332 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:21.519711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:21.519982 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:21.521740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:21.531798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:21.533216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:21.541115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1409/2770] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:23:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:23:21.862105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:21.863542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:21.935178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ddc4a-cdf7-4771-bbce-3f2e11a4711c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:21.940116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:21.940759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:21.941039 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:21.941313 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:21.943038 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:21.955136 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:21.956722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:21.966669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1362/2771] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:23:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:23:24.428739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:24.430905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:24.455252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe59fdd-73e8-4e25-8ae5-3f044b6c9e1a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:24.460975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:24.461610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:24.461888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:24.462162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:24.464799 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:24.477692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:24.479327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fda1a-7f07-4162-a255-8570a67252bd service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:24.491344 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1410/2772] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:23:31.707450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:23:31.708882 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:31.725241 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76582f-bf3c-414d-bd94-8a4e1b146da6 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:23:31.731464 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:23:31.732087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:23:31.732367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:23:31.732669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:23:31.734439 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:23:31.746800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:23:31.748361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:23:31.759115 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1363/2773] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:23:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:23:34.486379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=12 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:23:41.754433 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=63 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:01.647536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba369-2176-44dd-aae6-d842c7818db7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:01.648126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba369-2176-44dd-aae6-d842c7818db7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:01.648126 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba369-2176-44dd-aae6-d842c7818db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:01.673133 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-971ba369-2176-44dd-aae6-d842c7818db7 None None] MFA Rules not processed for user `eab1f0126d634ebd886403914d17ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:25:01.674632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-971ba369-2176-44dd-aae6-d842c7818db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:01.681718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1411/2774] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:25:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:25:11.664106 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:25:56.246685 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:25:56.258276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb371-146e-4ca5-af69-f41dd5c11894 service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:25:56.263250 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:25:56.263864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:25:56.264142 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:25:56.264409 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:25:56.266266 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:25:56.278394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:25:56.279977 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:25:56.291093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1364/2775] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:25:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:06.286514 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:43.147335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:43.147959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:43.147959 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:43.167180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] MFA Rules not processed for user `eab1f0126d634ebd886403914d17ea42`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:26:43.168380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:43.175208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1412/2776] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:26:43.512878 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:43.523125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5219c-28f8-4dd9-923a-092512321f4c service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:43.526860 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:43.527501 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:43.527757 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:43.528025 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:43.530143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:43.541447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:43.542871 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:43.551879 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1365/2777] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:44.818546 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:26:44.828846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15810b35-cc84-4944-a9fb-5496ff14e72c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:26:44.832621 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:26:44.833264 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:26:44.833539 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:26:44.833803 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:26:44.835617 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:26:44.847791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:26:44.849397 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:26:44.859577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1413/2778] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:26:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:26:53.547507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=6 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:54.854351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=9 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:06.619507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:06.628726 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd5ed9-f997-4da5-9414-4e3ec82f069f service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:06.633128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:06.633748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:06.634021 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:06.634295 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:06.641891 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:06.643305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:06.651225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1366/2779] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:13.133393 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:13.134840 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:13.189806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511802f6-d0dd-4f66-a331-14a0cf68fa82 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:13.193989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:13.194599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:13.194876 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:13.195141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:13.205358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:13.206768 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:13.218270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1414/2780] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:15.831051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:15.840855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd03a8-d4ff-4d8e-a8c5-655c84e198c7 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:15.844608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:15.845236 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:15.845516 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:15.845785 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:15.856556 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:15.858000 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:15.869354 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1367/2781] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:23.213608 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=26 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:25.445490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:25.446976 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:25.459518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7fa55-db0b-40b4-b318-013028eef0de service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:25.463164 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:25.463774 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:25.464076 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:25.464325 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:25.466123 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:25.529532 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:25.530958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:25.542179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1415/2782] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:28:25.863978 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=12 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:28.568051 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:28.570746 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:28.591027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08f27-5da9-455c-83d1-b023599760fd service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:28.597523 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:28.598525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:28.599048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:28.600068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:28.602268 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:28.622642 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:28.627652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:28.628001 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:28.629449 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:28.647916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144dc70-93f5-4c4e-942d-0b65a67511c5 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:28.658687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:28.659499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:28.659765 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:28.660041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] PATH_INFO: `/v3/users/eab1f0126d634ebd886403914d17ea42` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:28.663827 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1368/2783] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:28.670836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab1f0126d634ebd886403914d17ea42)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:28.673798 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:28.726490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab1f0126d634ebd886403914d17ea42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:28.727136 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab1f0126d634ebd886403914d17ea42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:28.738987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab1f0126d634ebd886403914d17ea42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:28.747794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab1f0126d634ebd886403914d17ea42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:28.748510 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5c16b2d0-f1ba-412e-baec-0f0db2b98ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab1f0126d634ebd886403914d17ea42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:28.760830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1416/2784] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:28:28 2022] DELETE /identity/v3/users/eab1f0126d634ebd886403914d17ea42 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:28.933042 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:28.950548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e336d-f13e-49b8-af5a-68ff226a595e service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.008116 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.008780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.009055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.009322 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] PATH_INFO: `/v3/projects/498c7ca752674265a207ac29d9759b06` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.010436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498c7ca752674265a207ac29d9759b06)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.012309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.057582 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498c7ca752674265a207ac29d9759b06', 'request_id': 'req-4c47e241-fbe3-444f-b3a7-f15d27cee419'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:29.063513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498c7ca752674265a207ac29d9759b06', 'request_id': 'req-4c47e241-fbe3-444f-b3a7-f15d27cee419'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:29.069602 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498c7ca752674265a207ac29d9759b06', 'request_id': 'req-4c47e241-fbe3-444f-b3a7-f15d27cee419'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:29.081858 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] The token cache is being invalidate because project 498c7ca752674265a207ac29d9759b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:28:29.082150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:29.082777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-4c47e241-fbe3-444f-b3a7-f15d27cee419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:29.088045 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1369/2785] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:28:28 2022] DELETE /identity/v3/projects/498c7ca752674265a207ac29d9759b06 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:29.089648 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.089935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.090208 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.111054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:28:29.112339 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:29.179507 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1417/2786] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:28:29.187404 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.187694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.187972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.207638 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:28:29.208929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:29.216713 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1370/2787] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:28:29.221222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.230871 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e6ff4-f119-4e78-893b-af60ed049532 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.235311 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.235911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.236187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.236454 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.237168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:28:29.237469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.239057 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.241027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:29.252577 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1418/2788] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:28:29.257326 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.266371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb4916-a954-4b4b-b4a2-2a82242e3f7a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.270943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.271537 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.271807 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.272070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.272744 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.274600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.310243 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1371/2789] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:28:29.313750 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.324381 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503a133-4a1c-4fdb-b3c6-6ba1d3968b4e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.379484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.380014 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.380292 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.380563 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.381234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.383117 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.403791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1419/2790] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:28:29.408702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.419546 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffd424-0322-4875-9d1f-c9f8270c6d59 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.424165 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.424812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.425093 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.425364 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.426058 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.428265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.438107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1372/2791] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:28:29.442219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.452846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7d13-5cb2-4357-ade7-9188bbdbe4ef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.457363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.457965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.458236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.458499 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.459192 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.460791 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa11c0-a9c2-496b-924d-ef31ec0da275 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.471596 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1420/2792] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:28:29.476648 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.486517 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361905-719b-40e9-93c7-7c5f2cb68d15 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.491608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.492265 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.492543 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.492849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] PATH_INFO: `/v3/projects/97a896f903d84539b79c13a8e4cb27d5/users/555577ccdde94378849ce4421851aa58/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.507233 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a896f903d84539b79c13a8e4cb27d5, user_id=555577ccdde94378849ce4421851aa58, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.509897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.522289 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1373/2793] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:28:29 2022] PUT /identity/v3/projects/97a896f903d84539b79c13a8e4cb27d5/users/555577ccdde94378849ce4421851aa58/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:29.532569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.532888 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.533156 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.561354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] MFA Rules not processed for user `555577ccdde94378849ce4421851aa58`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:28:29.562552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:29.624896 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1421/2794] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:28:29.629388 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.635173 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:29.691802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32abe4e-e198-4032-80ef-652e49d57395 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.697154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.697772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.698048 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.698317 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.698988 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.700901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.728652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1374/2795] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:28:29.732786 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.743996 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00e2c-6516-4c7f-9d87-f225da5a10f2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.798677 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.799282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.799557 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.799822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.800469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.802901 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.811649 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:29.826314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1422/2796] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:28:29 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:28:29.830328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.840881 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc055d9b-cfd4-4c21-a998-0eaa4bf29dbf admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.845834 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.846452 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.846734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.847049 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.847777 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.849491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.860345 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1375/2797] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:28:29.864479 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.875028 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628c426-5432-48e4-8d0f-6b89fa452308 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.879604 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.880256 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.881180 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.881478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] PATH_INFO: `/v3/projects/28405f54c4434ec387c076c73b1f74e2/users/10aa8d9469a943f2963e99ec6c4d59a0/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.895841 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28405f54c4434ec387c076c73b1f74e2, user_id=10aa8d9469a943f2963e99ec6c4d59a0, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.898485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.910864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1423/2798] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:28:29 2022] PUT /identity/v3/projects/28405f54c4434ec387c076c73b1f74e2/users/10aa8d9469a943f2963e99ec6c4d59a0/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:29.914804 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:29.924724 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5183786-c91d-4aa5-90ca-9bf4bac46eb1 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:29.980980 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:29.981596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:29.981873 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:29.982152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:29.982821 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:29.984403 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653ea9-74f5-4039-b51a-fa13cfa82023 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:29.994618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1376/2799] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:28:29.998790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:30.010262 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea75199-f150-4f98-ba12-b891886a512f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:30.014905 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:30.015551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:30.015827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:30.016096 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] PATH_INFO: `/v3/projects/28405f54c4434ec387c076c73b1f74e2/users/10aa8d9469a943f2963e99ec6c4d59a0/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:30.018049 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28405f54c4434ec387c076c73b1f74e2, user_id=10aa8d9469a943f2963e99ec6c4d59a0, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:30.020687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:30.030740 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1424/2800] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:28:29 2022] PUT /identity/v3/projects/28405f54c4434ec387c076c73b1f74e2/users/10aa8d9469a943f2963e99ec6c4d59a0/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:30.042157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:30.042440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:30.042734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:30.070600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] MFA Rules not processed for user `10aa8d9469a943f2963e99ec6c4d59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:28:30.071780 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:30.138040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:30.146114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1377/2801] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:28:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:28:30.153382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:30.155090 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:30.211651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54173c2-9009-487c-ba14-60335bce4255 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:30.215351 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:30.215958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:30.216239 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:30.216511 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:30.226324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:30.227733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:30.237125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1425/2802] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:30.310590 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:30.320225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b6df-91cb-4e60-b581-d6482332fca7 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:30.323783 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:30.324384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:30.324683 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:30.324955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:30.381690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:30.383114 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39407ad6-5334-42be-923e-98bdeec14e15 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:30.391983 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1378/2803] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:28:40.232979 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:40.388027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=28 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:59.701569 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:59.761628 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7f7fc-cfbe-49e5-89bd-3f8783d21826 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:28:59.766054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:28:59.766680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:59.766958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:59.767226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] PATH_INFO: `/v3/users/555577ccdde94378849ce4421851aa58` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:59.768358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555577ccdde94378849ce4421851aa58)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:28:59.770291 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:28:59.815865 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555577ccdde94378849ce4421851aa58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:59.816536 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555577ccdde94378849ce4421851aa58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:59.828526 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555577ccdde94378849ce4421851aa58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:59.835647 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555577ccdde94378849ce4421851aa58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:59.836295 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555577ccdde94378849ce4421851aa58'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:28:59.848997 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1426/2804] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:28:59 2022] DELETE /identity/v3/users/555577ccdde94378849ce4421851aa58 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:28:59.853454 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:28:59.853958 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:28:59.854062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:28:59.873103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:28:59.874308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:28:59.931742 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1379/2805] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:28:59.941440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:28:59.942830 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:00.000915 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118a97-cab6-4e0d-be3e-9ac487056212 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:00.004651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:00.005270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:00.005547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:00.005810 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:00.015067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:00.016466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:00.026680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1427/2806] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:00.294989 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:00.296450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:00.313384 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e558693-2ae0-4e72-aa6d-cdb7ac4cb091 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:00.318644 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:00.319178 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:00.319608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:00.319901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] PATH_INFO: `/v3/projects/97a896f903d84539b79c13a8e4cb27d5` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:00.321086 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a896f903d84539b79c13a8e4cb27d5)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:00.323467 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:00.370124 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a896f903d84539b79c13a8e4cb27d5', 'request_id': 'req-c8125660-b201-480b-aa5f-f16678bea47a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.376175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a896f903d84539b79c13a8e4cb27d5', 'request_id': 'req-c8125660-b201-480b-aa5f-f16678bea47a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.381954 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a896f903d84539b79c13a8e4cb27d5', 'request_id': 'req-c8125660-b201-480b-aa5f-f16678bea47a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.394263 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] The token cache is being invalidate because project 97a896f903d84539b79c13a8e4cb27d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:00.394547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.395154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.396630 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1380/2807] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:00 2022] DELETE /identity/v3/projects/97a896f903d84539b79c13a8e4cb27d5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:00.400742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:00.410667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd563-7b39-4792-b9ca-2a9c709c6498 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:00.428735 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:00.470067 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:00.470707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:00.470987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:00.471259 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] PATH_INFO: `/v3/users/10aa8d9469a943f2963e99ec6c4d59a0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:00.472405 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10aa8d9469a943f2963e99ec6c4d59a0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:00.474358 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:00.519929 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10aa8d9469a943f2963e99ec6c4d59a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.520568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10aa8d9469a943f2963e99ec6c4d59a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.532335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10aa8d9469a943f2963e99ec6c4d59a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.538699 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10aa8d9469a943f2963e99ec6c4d59a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.539350 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b2c701c-5b84-47dc-8f2b-4d2ae0deee02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10aa8d9469a943f2963e99ec6c4d59a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.551399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1428/2808] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:00 2022] DELETE /identity/v3/users/10aa8d9469a943f2963e99ec6c4d59a0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:00.831423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:00.832890 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:00.845935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125660-b201-480b-aa5f-f16678bea47a admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:00.902298 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:00.902964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:00.903123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:00.903393 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] PATH_INFO: `/v3/projects/28405f54c4434ec387c076c73b1f74e2` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:00.904520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28405f54c4434ec387c076c73b1f74e2)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:00.906443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:00.938747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:00.968668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28405f54c4434ec387c076c73b1f74e2', 'request_id': 'req-d11103d1-74da-46ab-98e4-79c81a07884a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.968668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28405f54c4434ec387c076c73b1f74e2', 'request_id': 'req-d11103d1-74da-46ab-98e4-79c81a07884a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.972992 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28405f54c4434ec387c076c73b1f74e2', 'request_id': 'req-d11103d1-74da-46ab-98e4-79c81a07884a'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.986267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] The token cache is being invalidate because project 28405f54c4434ec387c076c73b1f74e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:00.986549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.987152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-d11103d1-74da-46ab-98e4-79c81a07884a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:00.988784 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1381/2809] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:00 2022] DELETE /identity/v3/projects/28405f54c4434ec387c076c73b1f74e2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:00.993753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:00.995074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:00.995074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.014108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:01.015327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:01.073680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1429/2810] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:29:01.081991 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.082276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.082549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.103214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:01.105106 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:01.113363 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1382/2811] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:01.117711 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.127482 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf305d1-aba0-4fcf-8321-676fa729ad23 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.132059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.132694 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.132978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.133251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.133943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:29:01.134247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.135822 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.147560 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1430/2812] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 06:29:01.152832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.162096 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511b44a-c816-4e64-b822-5e2fbca89cdd None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.167319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.167938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.168214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.168485 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.169207 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.171099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.200069 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1383/2813] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:01.204318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.214724 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7b24-f6ad-4040-9704-dfeffff45c9f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.241651 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:01.278037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.278663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.278943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.279214 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.279891 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.281854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.303461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1431/2814] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:29:01.308346 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.318612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341798b8-0657-4697-8e07-ec70fc2aafd9 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.324007 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.324612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.324919 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.325186 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.325902 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.327562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.338110 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1384/2815] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:01.342533 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.353052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdce1-5f0c-425b-b47d-85c5e093280a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.357672 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.358276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.358550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.358818 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.359495 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.361098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bc103-a086-41fe-b9ee-742f948c900a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.371899 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1432/2816] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:29:01.376751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.388389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35446-8497-404d-8263-e84c9852fc51 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.393099 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.393766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.394037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.394304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] PATH_INFO: `/v3/projects/55c5b59db1e24dbcae1f5e897ab20ca9/users/7af20bcff362488dbed35e97e197bba2/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.410674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c5b59db1e24dbcae1f5e897ab20ca9, user_id=7af20bcff362488dbed35e97e197bba2, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.413252 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.430419 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1385/2817] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:01 2022] PUT /identity/v3/projects/55c5b59db1e24dbcae1f5e897ab20ca9/users/7af20bcff362488dbed35e97e197bba2/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:01.496831 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.497108 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.497371 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.528752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] MFA Rules not processed for user `7af20bcff362488dbed35e97e197bba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:01.529967 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:01.613378 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1433/2818] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:29:01.618075 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.692593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ce05-987c-4233-8146-019768c52515 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.699304 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.699956 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.700230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.700492 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.701200 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.703105 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.734023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1386/2819] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:29:01.738029 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.748859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40902c03-f5b3-44ed-a283-8877e9c05ee4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.807059 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.807593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.808977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.808977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.808977 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.811317 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.836290 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1434/2820] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:01 2022] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:29:01.841643 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.856046 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7a92a-7859-4a46-8c47-f6f8657f998c admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.860690 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.861311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.861589 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.861859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.862559 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.864154 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.875283 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1387/2821] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:01.879931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.890824 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff88fe-ff4e-490f-bdc6-8b626680ba84 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.895567 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:01.896267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:01.896548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:01.896851 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] PATH_INFO: `/v3/projects/5576422f59d04df4a51262692a3e0763/users/a7f878563d974949ba83b1b960ee709d/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:01.912902 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5576422f59d04df4a51262692a3e0763, user_id=a7f878563d974949ba83b1b960ee709d, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:01.915601 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:01.929458 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1435/2822] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:01 2022] PUT /identity/v3/projects/5576422f59d04df4a51262692a3e0763/users/a7f878563d974949ba83b1b960ee709d/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:01.933507 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:01.944056 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6294b9f-db4f-4137-8c90-68b4a908c704 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:01.964577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:02.004274 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:02.004957 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.005350 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.005635 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.006335 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:02.007960 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b7689-8fe2-404e-ada8-27802c33f4ce admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:02.018077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1388/2823] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:02.022466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:02.028453 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:02.034727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1263f3-1f80-4f32-bdae-431b79fb30e1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:02.039900 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:02.040568 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.041466 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.041742 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] PATH_INFO: `/v3/projects/5576422f59d04df4a51262692a3e0763/users/a7f878563d974949ba83b1b960ee709d/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.043682 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5576422f59d04df4a51262692a3e0763, user_id=a7f878563d974949ba83b1b960ee709d, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:02.046370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:02.056457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1436/2824] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:02 2022] PUT /identity/v3/projects/5576422f59d04df4a51262692a3e0763/users/a7f878563d974949ba83b1b960ee709d/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:02.066535 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.066826 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.067108 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.095621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] MFA Rules not processed for user `a7f878563d974949ba83b1b960ee709d`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:02.096869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:02.162824 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1389/2825] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:02.174072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:02.175722 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:02.233205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea52a0-0ff5-4e0b-846b-06ab2bfaa744 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:02.236771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:02.237384 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.237663 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.237931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.246846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:02.248266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:02.257588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1437/2826] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:02.333009 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:02.343214 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95275f-040e-43d3-85bf-ae1f1f93129c None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:02.347062 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:02.347670 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:02.347948 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:02.348224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:02.406269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:02.407706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa7e8-264b-4128-9e34-8d2c1da6cfc9 service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:02.416705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1390/2827] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:06.454988 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:06.516597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8b9d0-d894-4801-bb8f-45d7731efa88 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:06.522282 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:06.522912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:06.523187 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:06.523455 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] PATH_INFO: `/v3/users/7af20bcff362488dbed35e97e197bba2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:06.524587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af20bcff362488dbed35e97e197bba2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:06.526587 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:06.571175 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af20bcff362488dbed35e97e197bba2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.571804 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af20bcff362488dbed35e97e197bba2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.585334 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af20bcff362488dbed35e97e197bba2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.592625 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af20bcff362488dbed35e97e197bba2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.593250 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af20bcff362488dbed35e97e197bba2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:06.605637 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1438/2828] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:06 2022] DELETE /identity/v3/users/7af20bcff362488dbed35e97e197bba2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:06.610091 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:06.610576 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:06.610698 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:06.630189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:06.631303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:06.670524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=100 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:06.688864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1391/2829] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:29:06.699054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:06.700456 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:06.717315 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:06.774744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4df3a-5cc3-4cc6-b199-63c422e7a6df admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:06.778389 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:06.779000 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:06.779276 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:06.779541 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:06.788670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:06.790077 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:06.800035 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1439/2830] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:07.076399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.078055 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:07.091947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1544fdc-6560-43ae-9a69-03c42bd4351f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:07.098692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:07.102309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.102309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.102309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] PATH_INFO: `/v3/projects/55c5b59db1e24dbcae1f5e897ab20ca9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.102309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c5b59db1e24dbcae1f5e897ab20ca9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:07.103941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:07.149634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c5b59db1e24dbcae1f5e897ab20ca9', 'request_id': 'req-51c323e1-0f38-4529-942d-64a7f42b28b7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.156203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c5b59db1e24dbcae1f5e897ab20ca9', 'request_id': 'req-51c323e1-0f38-4529-942d-64a7f42b28b7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.161612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c5b59db1e24dbcae1f5e897ab20ca9', 'request_id': 'req-51c323e1-0f38-4529-942d-64a7f42b28b7'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.174342 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] The token cache is being invalidate because project 55c5b59db1e24dbcae1f5e897ab20ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:07.174623 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.175230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.176739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1392/2831] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:07 2022] DELETE /identity/v3/projects/55c5b59db1e24dbcae1f5e897ab20ca9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:07.180863 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.190811 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb2f-c34e-44cf-a3df-39e0c903fc0a service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:07.246141 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:07.246771 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.247052 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.247326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] PATH_INFO: `/v3/users/a7f878563d974949ba83b1b960ee709d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.248478 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f878563d974949ba83b1b960ee709d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:07.250414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:07.296046 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f878563d974949ba83b1b960ee709d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.296762 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f878563d974949ba83b1b960ee709d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.308327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f878563d974949ba83b1b960ee709d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.315562 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f878563d974949ba83b1b960ee709d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.316166 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f3cc0ac5-0599-4f1f-8e07-dfee6bea2a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f878563d974949ba83b1b960ee709d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.327973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1440/2832] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:07 2022] DELETE /identity/v3/users/a7f878563d974949ba83b1b960ee709d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:07.601132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.602710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:07.617434 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c323e1-0f38-4529-942d-64a7f42b28b7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:07.675934 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:07.676588 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.676895 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.677168 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] PATH_INFO: `/v3/projects/5576422f59d04df4a51262692a3e0763` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.678316 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5576422f59d04df4a51262692a3e0763)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:07.680269 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:07.728401 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5576422f59d04df4a51262692a3e0763', 'request_id': 'req-b7dbec26-7be8-42fd-ac91-915c45be3681'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.734361 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5576422f59d04df4a51262692a3e0763', 'request_id': 'req-b7dbec26-7be8-42fd-ac91-915c45be3681'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.739897 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5576422f59d04df4a51262692a3e0763', 'request_id': 'req-b7dbec26-7be8-42fd-ac91-915c45be3681'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.748338 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:07.753273 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] The token cache is being invalidate because project 5576422f59d04df4a51262692a3e0763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:07.753786 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.754861 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-b7dbec26-7be8-42fd-ac91-915c45be3681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:07.756491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1393/2833] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:07 2022] DELETE /identity/v3/projects/5576422f59d04df4a51262692a3e0763 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:07.761991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.762472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.762594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.782329 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:07.783543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:07.812702 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:07.845703 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1441/2834] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:07.854679 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.854966 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.855242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.876916 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:07.878232 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:07.886547 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1394/2835] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:07.890788 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.900574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8d10-fb4e-4d12-860d-b6187d21f8e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:07.905377 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:07.905972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.906254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.906527 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.907217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:29:07.907524 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:07.909142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:07.920632 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1442/2836] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:29:07.925085 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.934795 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4a90-3165-4e4a-b0e7-80115e35464a None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:07.939325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:07.939926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:07.940203 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:07.940475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:07.941160 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:07.943031 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:07.971947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1395/2837] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:07 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:07.976766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:07.989074 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91061658-c0ea-4af0-9f79-6ce08051b004 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.044772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.045380 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.045664 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.045931 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.046610 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.048528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.069920 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1443/2838] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:07 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:08.074695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.085095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a8ed-55fc-4924-ae0b-8e581bc7a79f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.090034 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.090655 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.090943 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.091202 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.091947 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.093600 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.104217 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1396/2839] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:08.108272 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.118518 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ed5e-9c47-442d-b953-e1b3435b022a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.123529 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.124132 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.124416 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.124716 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.125403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.126975 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92802f66-a615-4b90-ad09-514814b2098b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.138277 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1444/2840] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:08.142390 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.152199 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad93-5ab2-4717-9200-7ae00f641b2b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.156739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.157389 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.157669 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.157941 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] PATH_INFO: `/v3/projects/6822a5fe72e94ee0aa163ab57f033360/users/c32f8ed73ea5482b9bb5364caab7df1f/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.172184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6822a5fe72e94ee0aa163ab57f033360, user_id=c32f8ed73ea5482b9bb5364caab7df1f, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.174828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.188849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1397/2841] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:08 2022] PUT /identity/v3/projects/6822a5fe72e94ee0aa163ab57f033360/users/c32f8ed73ea5482b9bb5364caab7df1f/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:08.199597 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.199881 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.200148 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.227041 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] MFA Rules not processed for user `c32f8ed73ea5482b9bb5364caab7df1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:08.228772 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:08.291345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1445/2842] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:08.296138 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.358436 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092447-e8a6-4aaa-b162-48d702bbbcf7 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.363118 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.363747 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.364004 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.364272 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.364959 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.366832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.394557 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1398/2843] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:08 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:08.398812 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.409634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0a1dc-7e8b-450a-ac35-7f381cd5c710 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.435911 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:08.465440 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.465973 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.466236 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.466497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.467157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.469327 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.490709 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1446/2844] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:08 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 06:29:08.495285 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.505548 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cfaac-cdca-4263-8858-51a7c05854f6 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.510248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.510848 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.511174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.511444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.512120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.513754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.524359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1399/2845] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:29:08.528385 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.538414 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14a84b-d573-4ef8-a06a-caa76fbcefb9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.543603 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.544254 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.544535 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.544836 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] PATH_INFO: `/v3/projects/04f5cd6279f641ada26026b07d17c803/users/33dd6d90672b4c179381da630f6b2423/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.561640 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f5cd6279f641ada26026b07d17c803, user_id=33dd6d90672b4c179381da630f6b2423, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.564303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.577091 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1447/2846] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:08 2022] PUT /identity/v3/projects/04f5cd6279f641ada26026b07d17c803/users/33dd6d90672b4c179381da630f6b2423/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:08.580968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.591803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ca084-dbda-4d72-8e6a-ce0a1d1840ee admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.645936 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.646611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.646802 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.647068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.647745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.649348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da07b-9d8d-41c5-87b1-d23a40b5e988 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.660297 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1400/2847] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:08.664472 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.675251 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a02b-b147-43ed-b664-2a805c10e6ba admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.680042 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.680707 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.680983 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.681275 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] PATH_INFO: `/v3/projects/04f5cd6279f641ada26026b07d17c803/users/33dd6d90672b4c179381da630f6b2423/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.683158 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f5cd6279f641ada26026b07d17c803, user_id=33dd6d90672b4c179381da630f6b2423, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.685838 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.695737 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1448/2848] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:08 2022] PUT /identity/v3/projects/04f5cd6279f641ada26026b07d17c803/users/33dd6d90672b4c179381da630f6b2423/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:08.705925 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.706210 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.706483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.714942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:08.735087 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] MFA Rules not processed for user `33dd6d90672b4c179381da630f6b2423`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:08.736230 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:08.806680 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1401/2849] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:08.817382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:08.819429 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:08.876296 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43e6e6-8084-4959-95be-4d7ea616e525 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:08.879944 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:08.880547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:08.880916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:08.881182 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:08.891919 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:08.893363 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ca424-5567-41b9-9ac8-d787f7f55d95 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:08.903528 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1449/2850] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:09.037279 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:09.099472 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c4a65-1358-43f4-a77e-96dedd5c4603 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:09.103949 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:09.104586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:09.104901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:09.105169 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] PATH_INFO: `/v3/users/c32f8ed73ea5482b9bb5364caab7df1f` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:09.106301 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32f8ed73ea5482b9bb5364caab7df1f)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:09.108222 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:09.153112 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32f8ed73ea5482b9bb5364caab7df1f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.159739 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32f8ed73ea5482b9bb5364caab7df1f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.160370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32f8ed73ea5482b9bb5364caab7df1f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.166767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32f8ed73ea5482b9bb5364caab7df1f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.178566 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32f8ed73ea5482b9bb5364caab7df1f'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.184293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1402/2851] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:09 2022] DELETE /identity/v3/users/c32f8ed73ea5482b9bb5364caab7df1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:09.189222 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:09.189516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:09.189794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:09.210874 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:09.212082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:09.270981 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1450/2852] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:09.281246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:09.282636 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:09.293386 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:09.340734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd66bf-cfd4-4368-9431-a386eab6c6e0 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:09.344572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:09.345224 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:09.345503 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:09.345775 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:09.354772 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:09.356184 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:09.365542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1403/2853] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:29:09.640690 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:09.642115 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:09.654107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8efa9b-6dc7-4e86-a5cb-6674d7a34e08 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:09.659168 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:09.659815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:09.660098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:09.660399 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] PATH_INFO: `/v3/projects/6822a5fe72e94ee0aa163ab57f033360` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:09.661678 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6822a5fe72e94ee0aa163ab57f033360)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:09.663864 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:09.691671 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:09.717790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6822a5fe72e94ee0aa163ab57f033360', 'request_id': 'req-0a48d601-5130-43f2-826d-4d0df6d3de70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.724099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6822a5fe72e94ee0aa163ab57f033360', 'request_id': 'req-0a48d601-5130-43f2-826d-4d0df6d3de70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.730162 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6822a5fe72e94ee0aa163ab57f033360', 'request_id': 'req-0a48d601-5130-43f2-826d-4d0df6d3de70'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.742308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] The token cache is being invalidate because project 6822a5fe72e94ee0aa163ab57f033360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:09.742593 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.743216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.745324 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1451/2854] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:09 2022] DELETE /identity/v3/projects/6822a5fe72e94ee0aa163ab57f033360 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:09.749305 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:09.759107 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd411f8a-fbba-41ec-922d-a27185fc64d8 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:09.814191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:09.814864 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:09.815191 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:09.815657 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] PATH_INFO: `/v3/users/33dd6d90672b4c179381da630f6b2423` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:09.816855 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dd6d90672b4c179381da630f6b2423)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:09.818790 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:09.863651 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dd6d90672b4c179381da630f6b2423'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.870935 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dd6d90672b4c179381da630f6b2423'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.871586 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dd6d90672b4c179381da630f6b2423'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.879443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dd6d90672b4c179381da630f6b2423'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.891572 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-a2990d0e-8056-4fbd-ae73-ee7c07d6cf98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dd6d90672b4c179381da630f6b2423'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:09.897618 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1404/2855] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:09 2022] DELETE /identity/v3/users/33dd6d90672b4c179381da630f6b2423 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:29:10.174757 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.176204 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:10.195352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48d601-5130-43f2-826d-4d0df6d3de70 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.251994 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.252626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.253084 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.253352 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] PATH_INFO: `/v3/projects/04f5cd6279f641ada26026b07d17c803` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.254469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f5cd6279f641ada26026b07d17c803)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.256335 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.301748 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f5cd6279f641ada26026b07d17c803', 'request_id': 'req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:10.307613 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f5cd6279f641ada26026b07d17c803', 'request_id': 'req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:10.313017 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f5cd6279f641ada26026b07d17c803', 'request_id': 'req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:10.326121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] The token cache is being invalidate because project 04f5cd6279f641ada26026b07d17c803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:10.326406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:10.327022 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e19b5d4a-1fde-4ebf-a1cc-d131392fa234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:10.328594 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1452/2856] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:10 2022] DELETE /identity/v3/projects/04f5cd6279f641ada26026b07d17c803 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:10.333693 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.333981 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.334348 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.355627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:10.356811 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:10.381370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:10.416174 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1405/2857] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:29:10.425177 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.425464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.425738 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.445342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:10.446545 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:10.455098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1453/2858] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:10.459328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.469712 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a5935-b30c-406c-846a-6a67eb04992e None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.474182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.474789 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.475068 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.475337 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.476019 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:29:10.476320 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.477951 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.490097 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1406/2859] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:29:10.494989 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.504304 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91385f-2603-412d-b35e-56e2d05c1462 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.509023 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.509623 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.509895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.510157 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.510806 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.512692 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.539420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1454/2860] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:10 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:10.544260 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.554179 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54ddb-05e6-4aa0-b8bb-2d4819bd741d admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.610502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.611035 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.611311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.611577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.612226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.614135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.635695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1407/2861] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:10 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:10.640461 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.656816 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f810b5-1939-42aa-9bfa-08029c6d98c3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.661862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.662490 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.662763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.663030 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.663714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.665326 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.668247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:10.680260 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1455/2862] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:10.682239 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.693032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8ee6-113d-431f-89c3-668f49311f83 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.697781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.698550 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.698832 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.699102 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.699788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.701394 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543955ea-15c3-494d-a368-a3a13a05dba6 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.711894 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1408/2863] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:10.716312 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.727383 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a74112-629a-4ec2-839d-2d163931a996 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.732448 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.733121 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.733400 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.733669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] PATH_INFO: `/v3/projects/703775ee99db451db60c4f5678628b47/users/dd5ee859a18148c4bb69b6cae149973c/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.748427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703775ee99db451db60c4f5678628b47, user_id=dd5ee859a18148c4bb69b6cae149973c, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.751083 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.763815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1456/2864] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:10 2022] PUT /identity/v3/projects/703775ee99db451db60c4f5678628b47/users/dd5ee859a18148c4bb69b6cae149973c/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:10.769143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59b5a-5ad5-4346-9ca1-9eb8da536be1 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.769612 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59b5a-5ad5-4346-9ca1-9eb8da536be1 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.769729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59b5a-5ad5-4346-9ca1-9eb8da536be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.791692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b0f59b5a-5ad5-4346-9ca1-9eb8da536be1 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:10.792927 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b0f59b5a-5ad5-4346-9ca1-9eb8da536be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:10.859379 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1409/2865] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:10.869205 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:10.870925 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:10.927752 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353b77-2ace-4b9e-b4bf-ecb2fa2b00f6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:10.931379 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:10.931991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:10.932273 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:10.932550 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:10.941419 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:10.942823 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:10.952171 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1457/2866] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:11.586706 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:11.587103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:11.587502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:11.622225 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] MFA Rules not processed for user `dd5ee859a18148c4bb69b6cae149973c`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:11.623484 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:11.649976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:11.693522 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1410/2867] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:11.698666 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:11.708775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664fb79-922c-4545-a9d1-34bb9e6515df service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:11.713543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:11.714114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:11.714395 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:11.714667 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:11.715342 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:11.717354 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:11.746695 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1458/2868] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:11 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:11.750921 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:11.762561 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d90d0-f847-488e-a1d5-9f0ce5d55007 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:11.827490 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:11.828904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:11.829176 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:11.829450 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:11.830132 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:11.832077 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:11.856674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1411/2869] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:11 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:11.859885 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:11.871845 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d99b47-c9e9-4e7d-a506-7b58b2433ca7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:11.876391 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:11.877037 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:11.877314 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:11.877581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:11.878267 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:11.879847 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:11.893228 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1459/2870] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 06:29:11.897745 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:11.908010 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb8484-2b4b-45c2-b6b9-2589ddeac835 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:11.912491 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:11.913189 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:11.913473 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:11.913748 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] PATH_INFO: `/v3/projects/c0e9cf2d054340fb92e181c762428397/users/36fd24972d8e451d8ad718cf01bb715e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:11.928542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e9cf2d054340fb92e181c762428397, user_id=36fd24972d8e451d8ad718cf01bb715e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:11.931734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:11.946468 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1412/2871] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:11 2022] PUT /identity/v3/projects/c0e9cf2d054340fb92e181c762428397/users/36fd24972d8e451d8ad718cf01bb715e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:29:11.950953 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:11.961547 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0637-0e70-4544-b32d-6db4a8844f18 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:12.020912 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:12.021427 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:12.021708 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:12.021984 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:12.022670 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:12.024253 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524bb4f-438e-458d-9787-e743db279f2c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:12.034111 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1460/2872] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:12.038293 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:12.049226 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1492e-f99f-413e-926e-988627719898 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:12.053938 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:12.054596 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:12.054876 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:12.055152 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] PATH_INFO: `/v3/projects/c0e9cf2d054340fb92e181c762428397/users/36fd24972d8e451d8ad718cf01bb715e/roles/3cf212a578ac4df6b651c27b6cfdbac8` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:12.057754 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e9cf2d054340fb92e181c762428397, user_id=36fd24972d8e451d8ad718cf01bb715e, role_id=3cf212a578ac4df6b651c27b6cfdbac8)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:12.060359 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa453648-f37b-47e1-8ba3-67efb11be8b1 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:12.070378 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1413/2873] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:12 2022] PUT /identity/v3/projects/c0e9cf2d054340fb92e181c762428397/users/36fd24972d8e451d8ad718cf01bb715e/roles/3cf212a578ac4df6b651c27b6cfdbac8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:12.717376 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:12.717903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:12.717903 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:12.746271 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] MFA Rules not processed for user `36fd24972d8e451d8ad718cf01bb715e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:12.747370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:12.779487 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:12.839346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1461/2874] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:12.850123 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:12.850972 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:12.851246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:12.870524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] MFA Rules not processed for user `dd5ee859a18148c4bb69b6cae149973c`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:12.871751 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:12.932157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1414/2875] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 06:29:12.945065 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:12.946520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:13.019991 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b988d8-63e1-41dd-9b77-863c898ee5e8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:13.026026 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:13.026638 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:13.026913 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:13.027179 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:13.035003 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:13.036779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:13.045469 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1462/2876] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 06:29:13.593527 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:13.595267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:13.631619 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:13.678429 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bfb19-c427-4a37-9f93-3ec37103a8b6 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:13.684733 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:13.685365 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:13.685641 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:13.685911 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:13.687674 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:13.699143 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:13.700759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:13.710849 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1415/2877] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:16.233433 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:16.248790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d90d6-efd1-4dc1-bbb4-ef222bab8731 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:16.255538 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:16.256826 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:16.257579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:16.257579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:16.260848 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:16.274150 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:16.275779 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:16.286926 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1463/2878] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:21.531719 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:21.533368 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:21.549175 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f7c7c-1f5d-4654-9b6f-9a462f16b45c service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:21.555181 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b65b1e894e3d4d2eb08b7cddfeff1822', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:21.555801 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:21.556206 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:21.557017 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:21.558812 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:21.573475 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:21.575065 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:21.586267 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1416/2879] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:26.031215 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:26.032790 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:26.089069 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a80e5-e9bd-4f25-8562-0ab931524d8e service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:26.092611 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:26.093247 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:26.093520 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:26.093784 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:26.103098 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:26.105287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:26.115286 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1464/2880] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:31.581318 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=27 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:36.110457 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=82 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:45.078396 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:45.080027 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:45.161703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9955-1eb9-4357-aa26-63b702dffd2d service nova] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:45.166736 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:45.167353 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:45.167634 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:45.167907 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:45.169710 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:45.181306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:45.182909 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:45.192819 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1417/2881] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:45.859072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:45.965543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda86a80-58b5-4f9f-a252-24f32aa37a79 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:45.970406 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:45.971114 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:45.971319 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:45.971585 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] PATH_INFO: `/v3/users/dd5ee859a18148c4bb69b6cae149973c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:45.972766 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5ee859a18148c4bb69b6cae149973c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:45.974669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:46.019103 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5ee859a18148c4bb69b6cae149973c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.019739 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5ee859a18148c4bb69b6cae149973c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.031464 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5ee859a18148c4bb69b6cae149973c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.038669 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5ee859a18148c4bb69b6cae149973c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.039303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5ee859a18148c4bb69b6cae149973c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.051819 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1465/2882] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:45 2022] DELETE /identity/v3/users/dd5ee859a18148c4bb69b6cae149973c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:46.229705 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:46.245303 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3d83-82a8-4f69-bc72-26233c510168 service placement] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:46.300825 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:46.301459 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:46.301734 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:46.302005 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] PATH_INFO: `/v3/projects/703775ee99db451db60c4f5678628b47` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:46.303127 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703775ee99db451db60c4f5678628b47)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:46.305044 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:46.352605 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703775ee99db451db60c4f5678628b47', 'request_id': 'req-385f9b19-6084-4296-b722-2cdae8813e23'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.358761 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703775ee99db451db60c4f5678628b47', 'request_id': 'req-385f9b19-6084-4296-b722-2cdae8813e23'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.366092 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703775ee99db451db60c4f5678628b47', 'request_id': 'req-385f9b19-6084-4296-b722-2cdae8813e23'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.392962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] The token cache is being invalidate because project 703775ee99db451db60c4f5678628b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:46.393242 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.393856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.395343 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1418/2883] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:46 2022] DELETE /identity/v3/projects/703775ee99db451db60c4f5678628b47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:46.399255 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:46.400619 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:46.413497 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf5257-b802-4cd4-913f-7fb7d92d92c3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:46.447226 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:46.470512 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:46.471147 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:46.471425 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:46.471696 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] PATH_INFO: `/v3/users/36fd24972d8e451d8ad718cf01bb715e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:46.472958 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fd24972d8e451d8ad718cf01bb715e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:46.474814 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:46.520886 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fd24972d8e451d8ad718cf01bb715e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.521515 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fd24972d8e451d8ad718cf01bb715e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.533815 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fd24972d8e451d8ad718cf01bb715e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.540777 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fd24972d8e451d8ad718cf01bb715e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.541875 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5ff905e5-e55f-4c2f-a69e-edd81635d3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fd24972d8e451d8ad718cf01bb715e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.554199 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1466/2884] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:29:46 2022] DELETE /identity/v3/users/36fd24972d8e451d8ad718cf01bb715e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:46.728140 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:46.730692 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:46.743460 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f9b19-6084-4296-b722-2cdae8813e23 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:46.757371 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:46.801803 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:46.802444 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:46.802722 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:46.802994 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] PATH_INFO: `/v3/projects/c0e9cf2d054340fb92e181c762428397` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:46.804121 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e9cf2d054340fb92e181c762428397)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:46.806040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:46.851117 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e9cf2d054340fb92e181c762428397', 'request_id': 'req-f864b993-302a-4aca-89ac-bbe286fe86ae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.857691 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e9cf2d054340fb92e181c762428397', 'request_id': 'req-f864b993-302a-4aca-89ac-bbe286fe86ae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.863415 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e9cf2d054340fb92e181c762428397', 'request_id': 'req-f864b993-302a-4aca-89ac-bbe286fe86ae'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.875258 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] The token cache is being invalidate because project c0e9cf2d054340fb92e181c762428397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:29:46.875542 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.876149 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-f864b993-302a-4aca-89ac-bbe286fe86ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:29:46.877694 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1419/2885] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:29:46 2022] DELETE /identity/v3/projects/c0e9cf2d054340fb92e181c762428397 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:46.882590 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:46.883080 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:46.883216 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:46.903308 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:46.904516 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:46.968105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1467/2886] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:46.977311 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:46.977489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:46.977766 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.008696 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:47.009905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:47.017767 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1420/2887] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:47.022054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.032219 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0a7a-fe8a-4417-a2e2-567ec85d4bcb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.037056 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.037654 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.037935 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.038207 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.038894 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:29:47.039197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.040800 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.052542 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1468/2888] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:29:47.056613 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.065729 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549a6f-f4c6-4e59-b57d-77b3bbf81d52 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.070309 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.070904 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.071182 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.071453 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.072103 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.074023 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.106029 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1421/2889] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:29:47 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:47.110231 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.120054 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cc2c4-f59b-43cd-9634-b06eead4815a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.160827 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:47.177460 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.178075 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.178357 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.178629 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.179288 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.181243 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.201720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1469/2890] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:29:47 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:29:47.206037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.216955 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca457-4d86-4f6d-9e36-fa93769803ec admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.221776 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.222405 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.222668 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.222940 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.223649 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.225319 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.235205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1422/2891] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:47.239081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.248906 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4140-644f-4f05-972a-87e6b6e9a1dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.253442 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.254036 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.254328 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.254581 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.255301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.256895 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170dd6-d92e-4cff-ab5f-e2167345d863 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.267719 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1470/2892] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:29:47.271846 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.282382 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9489a7-5711-48ce-bf0c-49ab838200dc admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.286964 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.287763 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.289126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.289126 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] PATH_INFO: `/v3/projects/b3abc2b673464a6cba65c8cdc57a3247/users/6be0122e5bac43a996f520636f6bf065/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.302440 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3abc2b673464a6cba65c8cdc57a3247, user_id=6be0122e5bac43a996f520636f6bf065, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.305120 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.317513 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1423/2893] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:29:47 2022] PUT /identity/v3/projects/b3abc2b673464a6cba65c8cdc57a3247/users/6be0122e5bac43a996f520636f6bf065/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:29:47.323386 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902960f-17d8-4b55-9744-06998265ae59 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.323718 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902960f-17d8-4b55-9744-06998265ae59 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.324107 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902960f-17d8-4b55-9744-06998265ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.343481 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7902960f-17d8-4b55-9744-06998265ae59 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:47.344978 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7902960f-17d8-4b55-9744-06998265ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:47.402252 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1471/2894] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:47.411703 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:47.413512 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:47.459157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:47.471621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454c48-bd73-493f-a261-1556fa649072 admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:47.475349 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:47.475968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:47.476248 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:47.476524 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:47.486150 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:47.487521 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:47.497549 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1424/2895] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:48.120574 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05cf-3dc7-4c5a-ac35-b76937932847 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:48.121099 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05cf-3dc7-4c5a-ac35-b76937932847 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:48.121318 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e05cf-3dc7-4c5a-ac35-b76937932847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:48.149548 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f41e05cf-3dc7-4c5a-ac35-b76937932847 None None] MFA Rules not processed for user `6be0122e5bac43a996f520636f6bf065`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:48.150744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f41e05cf-3dc7-4c5a-ac35-b76937932847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:48.218972 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1472/2896] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:48.229727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:48.231128 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:48.288869 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721a037-13ec-4c43-a529-238ea18c9958 service neutron] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:48.292480 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80869e16da504629b8763a9eb3c4c901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:48.293125 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:48.293399 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:48.293664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:48.302443 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:48.303905 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:48.313611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1425/2897] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:49.663081 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243aeb-8466-4482-a800-8077d6b837ec None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:49.663588 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243aeb-8466-4482-a800-8077d6b837ec None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:49.663720 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243aeb-8466-4482-a800-8077d6b837ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:49.683202 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c6243aeb-8466-4482-a800-8077d6b837ec None None] MFA Rules not processed for user `6be0122e5bac43a996f520636f6bf065`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:29:49.684390 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c6243aeb-8466-4482-a800-8077d6b837ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:49.691142 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1473/2898] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:29:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:29:49.922397 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:29:49.931901 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9049-c01c-486b-81cd-2b71d593135d service cinder] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:29:49.935664 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:29:49.936276 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:29:49.936554 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:29:49.936856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:29:49.938608 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:29:49.948593 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:29:49.950032 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e549a8-7c0d-4d43-8b25-3c5216d5fd19 service neutron] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:29:49.958013 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1426/2899] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:29:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:29:59.677930 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:59.954381 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=38 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:06.282734 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:06.283263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:06.283263 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:06.303368 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] MFA Rules not processed for user `6be0122e5bac43a996f520636f6bf065`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:06.304578 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:06.311415 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1474/2900] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:30:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:16.298020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:23.266800 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ffa1b-9306-4980-9420-1cff08b8e15b None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:23.267296 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ffa1b-9306-4980-9420-1cff08b8e15b None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:23.267406 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ffa1b-9306-4980-9420-1cff08b8e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:23.327828 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-650ffa1b-9306-4980-9420-1cff08b8e15b None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:23.329078 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-650ffa1b-9306-4980-9420-1cff08b8e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:23.398325 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1427/2901] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jul 28 06:30:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:23.447773 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:23.449203 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:23.552579 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f1331-7a18-475a-a8da-bc62d3a694a1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:23.558139 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:23.558767 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:23.559733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:23.559733 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:23.569552 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:23.570859 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:23.581965 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1475/2902] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:30:33.396228 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=47 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:33.577125 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=41 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:39.018037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:39.018555 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:39.018678 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:39.037328 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] MFA Rules not processed for user `ad22ebee6031482a866b0276d8506f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:39.038518 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:39.046153 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1428/2903] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jul 28 06:30:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:39.058135 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:39.069780 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae227-7f15-40a4-a643-298b821dbb0c service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:39.074763 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4333399bc542e39a9f4d794dcccdf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:39.075403 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:39.075680 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:39.075951 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:39.084736 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:39.086370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:39.095787 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1476/2904] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jul 28 06:30:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 06:30:41.114968 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.127277 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e837b79-4cd1-4808-a57e-d1c6595c759f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.132057 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.132814 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.133205 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.133489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] PATH_INFO: `/v3/users/6be0122e5bac43a996f520636f6bf065` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.134652 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be0122e5bac43a996f520636f6bf065)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.136577 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.185883 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be0122e5bac43a996f520636f6bf065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.192836 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be0122e5bac43a996f520636f6bf065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.193502 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be0122e5bac43a996f520636f6bf065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.201022 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be0122e5bac43a996f520636f6bf065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.214024 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-fdd3babc-2a0f-43e0-9d39-4b75d6bf8668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be0122e5bac43a996f520636f6bf065'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.220896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1429/2905] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:30:41 2022] DELETE /identity/v3/users/6be0122e5bac43a996f520636f6bf065 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 06:30:41.399639 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.411475 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e89c76-2ee7-4ba6-a531-79ba167288d3 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.487846 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.488485 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.488813 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.489082 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] PATH_INFO: `/v3/projects/b3abc2b673464a6cba65c8cdc57a3247` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.490217 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3abc2b673464a6cba65c8cdc57a3247)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.492097 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.539382 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3abc2b673464a6cba65c8cdc57a3247', 'request_id': 'req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.545543 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3abc2b673464a6cba65c8cdc57a3247', 'request_id': 'req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.551353 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3abc2b673464a6cba65c8cdc57a3247', 'request_id': 'req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.565345 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] The token cache is being invalidate because project b3abc2b673464a6cba65c8cdc57a3247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:30:41.565626 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.566287 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f9e0a4c4-22ab-4f0f-b571-39e279c5f334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:30:41.567794 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1477/2906] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:30:41 2022] DELETE /identity/v3/projects/b3abc2b673464a6cba65c8cdc57a3247 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:30:41.572727 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.572976 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.573254 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.631448 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:41.632673 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:41.692884 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1430/2907] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:41.703105 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.703484 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.703755 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.726227 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:41.727428 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:41.735686 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1478/2908] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:41.740074 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.751015 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5197cf1-a7e8-4405-bff8-11c0a7c155d0 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.755896 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.756622 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.756929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.757275 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.757926 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80322) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 06:30:41.758370 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.759986 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.773306 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1431/2909] 10.222.0.66 () {58 vars in 1153 bytes} [Thu Jul 28 06:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 06:30:41.777636 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.787020 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753995-a237-43ff-a1ed-c513dfbc3b1d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.791634 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.792270 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.792553 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.792854 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.793514 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.795897 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.823303 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1479/2910] 10.222.0.66 () {60 vars in 1153 bytes} [Thu Jul 28 06:30:41 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:30:41.828253 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.838650 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4287170-026f-4ad4-b2cd-59519699c66f admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.857030 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:41.901476 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.902611 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.903135 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.903569 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] PATH_INFO: `/v3/users` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.904759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.907942 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.934219 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1432/2911] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jul 28 06:30:41 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 06:30:41.940010 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.950465 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4924-5b49-46de-a673-6ceadfe45b35 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.955230 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.955852 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.956131 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.956591 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.957505 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.959234 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:41.970426 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1480/2912] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:30:41.974672 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:41.985695 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad859d-ad45-4978-9950-f16bc9bed82b admin admin] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:41.990756 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:41.991447 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:41.991702 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:41.991953 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:41.992621 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:41.994246 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e730c3-7a38-44fb-b39f-89a6fd84a025 admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:42.008050 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1433/2913] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Jul 28 06:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 06:30:42.012483 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:42.023027 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47afbcb-c9d0-45d1-8167-6f25ab28c6e2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:42.027616 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:42.028278 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:42.028551 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:42.028855 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] PATH_INFO: `/v3/projects/6b11b4e952194cd5aae79486a5b69eb9/users/95fca16d6b1f4b1491ed5df1fab85252/roles/f51ffc831d584368858aa77465ba49ed` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:42.043038 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b11b4e952194cd5aae79486a5b69eb9, user_id=95fca16d6b1f4b1491ed5df1fab85252, role_id=f51ffc831d584368858aa77465ba49ed)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:42.046355 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:42.059946 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1481/2914] 10.222.0.66 () {60 vars in 1483 bytes} [Thu Jul 28 06:30:42 2022] PUT /identity/v3/projects/6b11b4e952194cd5aae79486a5b69eb9/users/95fca16d6b1f4b1491ed5df1fab85252/roles/f51ffc831d584368858aa77465ba49ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:30:42.071962 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:42.072249 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:42.072525 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:42.105445 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] MFA Rules not processed for user `95fca16d6b1f4b1491ed5df1fab85252`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:30:42.106889 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:42.179095 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1434/2915] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:30:42.191599 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:42.193420 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:30:42.211683 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:42.275916 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368be4-4548-4dd3-b364-c2d437ffbd82 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:30:42.280261 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b70241972c476bb596c1634149e69b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:30:42.280918 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:30:42.281198 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:30:42.281473 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:30:42.290744 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:30:42.292184 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:30:42.302753 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1482/2916] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:30:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:30:52.175929 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:52.298862 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=29 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:59.915661 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:30:59.917788 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:00.016235 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865c75c-ab38-498c-a086-b1943fdfa95f None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:00.021899 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:00.022520 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] REQUEST_METHOD: `GET` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:00.022797 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:00.023070 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:00.024856 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:00.036469 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:00.038098 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89879-a255-475d-8f49-ef3c008df320 service placement] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:00.047952 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1435/2917] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:09.520943 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:09.581607 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273dbb-aa79-48e4-a5b0-3ab2decae950 service glance] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:09.587072 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:09.587725 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:09.588008 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:09.588305 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] PATH_INFO: `/v3/users/95fca16d6b1f4b1491ed5df1fab85252` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:09.589710 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fca16d6b1f4b1491ed5df1fab85252)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:09.591564 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:09.643197 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fca16d6b1f4b1491ed5df1fab85252'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:09.643870 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fca16d6b1f4b1491ed5df1fab85252'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:09.657775 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fca16d6b1f4b1491ed5df1fab85252'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:09.665370 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fca16d6b1f4b1491ed5df1fab85252'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:09.666040 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fca16d6b1f4b1491ed5df1fab85252'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:09.678034 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1483/2918] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Jul 28 06:31:09 2022] DELETE /identity/v3/users/95fca16d6b1f4b1491ed5df1fab85252 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:31:09.682627 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] REQUEST_METHOD: `POST` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:09.683144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:09.683144 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:09.701859 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.auth.core [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] MFA Rules not processed for user `03e8dd2f02b7463797c3e9d1f831c5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80322) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 06:31:09.703037 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:09.759758 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1436/2919] 10.222.0.66 () {58 vars in 958 bytes} [Thu Jul 28 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 06:31:09.769410 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:09.771441 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:09.850281 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e6d6-4105-4f49-85d0-96d57ebe6f06 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:09.853956 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f022f8a1b5364341b0a0cdeaf7bc16e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:09.854566 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:09.854842 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:09.855109 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:09.864494 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:09.865933 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:09.875301 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1484/2920] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:31:10.143659 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] Authenticating user token {{(pid=80322) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:31:10.145704 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.fernet_utils [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80322) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:31:10.157367 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd4f6-9ffb-4b1a-8b35-709569e9b602 None None] Validating token access rules against request {{(pid=80322) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:31:10.162157 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03e8dd2f02b7463797c3e9d1f831c5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451944c8b2d04df49098731529a931c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80322) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:31:10.162759 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:31:10.163040 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:31:10.163308 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] PATH_INFO: `/v3/projects/6b11b4e952194cd5aae79486a5b69eb9` {{(pid=80322) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:31:10.164483 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b11b4e952194cd5aae79486a5b69eb9)` {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:31:10.166423 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] RBAC: Authorization granted {{(pid=80322) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:31:10.216781 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b11b4e952194cd5aae79486a5b69eb9', 'request_id': 'req-e19bbda7-3a16-4c41-a93c-e04db0e4614b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:10.224204 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b11b4e952194cd5aae79486a5b69eb9', 'request_id': 'req-e19bbda7-3a16-4c41-a93c-e04db0e4614b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:10.229840 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b11b4e952194cd5aae79486a5b69eb9', 'request_id': 'req-e19bbda7-3a16-4c41-a93c-e04db0e4614b'} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:10.232738 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:10.244562 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] The token cache is being invalidate because project 6b11b4e952194cd5aae79486a5b69eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80322) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 06:31:10.245347 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:10.245489 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG keystone.notifications [None req-e19bbda7-3a16-4c41-a93c-e04db0e4614b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80322) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 06:31:10.247079 dv-cinder-812429-2-smb devstack@keystone.service[80322]: [pid: 80322|app: 0|req: 1437/2921] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Jul 28 06:31:10 2022] DELETE /identity/v3/projects/6b11b4e952194cd5aae79486a5b69eb9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 06:31:19.871364 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:20.243805 dv-cinder-812429-2-smb devstack@keystone.service[80322]: DEBUG dbcounter [-] [80322] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=80322) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:04.946346 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 06:36:04.947714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:05.015681 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d46c2a-9534-42e1-8edf-0681051fc932 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 06:36:05.073095 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d15a61438b44de4bb2625f3b3b1622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8acce27c719462bbd65f2b683bbc913', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 06:36:05.073714 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 06:36:05.073987 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 06:36:05.074266 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 06:36:05.076019 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 06:36:05.089101 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 06:36:05.090687 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f399bc-e45c-4f00-a6ff-cbc3cceae5b6 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 06:36:05.101727 dv-cinder-812429-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1485/2922] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jul 28 06:36:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 06:36:15.096570 dv-cinder-812429-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=58 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}